Software Engineer - ML Ops (R37)
About The Position
As a Software Engineer for the ML Ops team, you will help own the production runtime for Phare’s ML stack - deploying, serving, and scaling models across inference endpoints and batch/streaming workflows. Every day you will build progressive delivery pipelines with automated rollouts and rollbacks, manage SLOs for latency and availability, and instrument end-to-end observability (metrics, logs, traces, drift, regression). You’ll harden the platform with Terraform, Kubernetes, and CI/CD, ensuring reproducible, auditable ML releases. To thrive in this role you must have a background in operating ML systems at scale, where uptime and feedback loops matter as much as accuracy.
Requirements
- Background in operating ML systems at scale.
- Experience deploying and operating models running on GPUs in production (APIs and batch/streaming inference).
- Strong with Docker/Kubernetes.
- Proficient in IaaC (e.g., Terraform).
- Experience with CI/CD for services and model artifacts.
- Ability to maintain environment parity, reproducible releases, and robust model/experiment versioning with data lineage.
- Experience using progressive delivery with automated rollouts/rollbacks.
- Ability to build end-to-end observability (metrics, logs, traces, and model telemetry for drift/regression) plus actionable alerting, runbooks, and incident response.
Nice To Haves
- Experience in regulated environments (e.g., healthcare, finance).
Responsibilities
- Deploy, serve, and scale models across inference endpoints and batch/streaming workflows.
- Build progressive delivery pipelines with automated rollouts and rollbacks.
- Manage SLOs for latency and availability.
- Instrument end-to-end observability (metrics, logs, traces, drift, regression).
- Harden the platform with Terraform, Kubernetes, and CI/CD.
- Ensure reproducible, auditable ML releases.
- Manage model registries and stage gates.
- Design scheduled or event-driven retraining when appropriate.
- Enforce RBAC, secrets management, encryption, and audit logs.
Benefits
- Top-of-market compensation, including bonus that starts at 10%
- Flexible PTO
- Comprehensive health benefits
- 401(k) matching
- Inspiring, brilliant, mission-driven teammates
- Opportunity to constantly learn
- Opportunity to collaborate across groups
- Opportunity to explore new paths for your career
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
