Machine Learning Engineer, Ops

Cantina

6d • $125,000 - $165,000 • Onsite

About The Position

We are looking for an MLOps Engineer to build and scale the inference infrastructure for our generative audio models, including Text-to-Speech (TTS), voice conversion, and Automatic Speech Recognition (ASR). You will be responsible for designing and deploying high-performance systems that ensure low-latency, reliable, and scalable model serving for both streaming and batch inference. This role is central to bridging the gap between research and production, ensuring our audio models are optimized for performance and cost-efficiency as we scale.

Requirements

• Deep understanding of modern audio model architectures (e.g., TTS, ASR) and their specific inference requirements.
• Strong hands-on experience with Kubernetes (K8S), container orchestration, and implementing autoscaling strategies for production workloads.
• Solid background in MLOps, including CI/CD automation and managing scalable cloud infrastructure.
• Proficiency in software engineering principles and experience with Python or Go for infrastructure tooling and backend services.
• Experience with GPU-accelerated inference and performance profiling techniques.

Nice To Haves

• Familiarity with high-performance inference engines (e.g., Triton Inference Server, vLLM-Omni) is a plus.

Responsibilities

• Design and maintain inference infrastructure for generative audio model architectures.
• Implement and manage high-performance inference engines.
• Orchestrate service deployments using Kubernetes (K8S), implementing advanced autoscaling paradigms to handle varying traffic loads efficiently.
• Develop and automate robust CI/CD pipelines to streamline the testing and deployment of model artifacts and inference configurations.
• Monitor production systems, establishing observability practices to track latency, resource utilization, and overall model performance.
• Collaborate closely with research teams to optimize model serving paths and evaluate various inference strategies.
• Optimize inference performance for both streaming and batch applications.

Benefits

• Competitive salary and generous company equity
• Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina
• 42 days of paid time off, including: 15 PTO days, 10 sick days, 15 company holidays, 2 floating holidays
• Generous parental leave & fertility support
• 401(k) retirement savings plan
• $500/month Lifestyle spending account
• Complimentary lunch and snacks for in-office employees
• One Medical membership

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed