Staff Software Engineer, Machine Learning

WellSaid Labs is seeking a Staff Software Engineer to join their ML Platform Team and contribute to the development and enhancement of their machine learning platform. The role involves optimizing the training pipeline, automating data processing, and improving abstraction layers. The ideal candidate should have experience in developing complex PyTorch models, deploying and monitoring models in production, and scaling machine learning services. Additionally, experience in leading deep learning projects and deploying deep learning models with PyTorch is preferred.

Iteratively and incrementally improving our TTS service's ease of use, reliability, and performance.

Building automated training and data processing services.

Scaling our platform to load, process and validate tens of thousands of hours of text and speech data.

Improving the performance and scalability of our machine learning training pipeline by integrating tools like DeepSpeed, PyTorch AMP, PyTorch JIT, and PyTorch Profiler.

Researching techniques for better fine tuning and quantizing our models.

Implementing processes to build confidence in our platform and services.

Surfacing and leading discussions on the AI ethics and the social impact of your work at WellSaid Labs.

Fostering an inclusive team culture and working environment.

Open-source reusable libraries and tooling.

Leading the development of a mature production machine-learning service.

Deploying deep learning models with PyTorch in the past 2 years.

Building and deploying ML models for use by a non-technical audience, clearly communicating usage guidelines and best practices.

Having great attention to detail.

• Experience developing complex PyTorch models
• Experience deploying and monitoring models in production
• Deep understanding of scaling machine learning services
• Experience leading the development of a mature production machine-learning service
• Deployment of deep learning models with PyTorch in the past 2 years
• Building and deploying ML models for use by a non-technical audience
• Attention to detail
• Affinity for creating modular, scalable, secure, and well-tested code
• Deep understanding of deep learning RND workflows, practices, and techniques
• Background using data structures and algorithms to process large amounts of data
• Experience implementing automating model training and data processing
• Experience implementing various tooling for speeding up training
• Strong cross-team collaboration skills
• Agile, iterative mentality and approach to problem-solving
• (Bonus) Experience building highly optimized layers (with C++, CUDA, etc.)
• (Bonus) Experience profiling and optimizing deep neural network performance
• (Bonus) Experience scaling models past a billion parameters
• Must be a U.S. Citizen or Permanent Resident
• Must pass a pre-employment background check

• Inclusive work environment that emphasizes personal and professional growth
• Fully distributed team throughout the U.S. with flexible schedules
• Supportive teammates available for help and collaboration
• Competitive salary and stock options
• Full medical, dental, and vision insurance
• Matching 401(k) plan
• Generous vacation policy/paid time off
• Parental leave
• Learning & development stipend
• Home office stipend
• Hiring salary range of $180-210k
• Opportunity for growth and advancement within the company
• Remote interview process with accommodations available