Senior ML Infra Engineer

Maxinsights Corporation • Santa Clara, CA

2d

About The Position

We are looking for a senior ML infrastructure engineer to build and evolve the systems that support model training, deployment, and production usage. This role sits at the intersection of software engineering, infrastructure, ML workflows, and developer experience. The work focuses on production-quality ML systems: reliability, scalability, observability, and usability for the team. You will work on training infrastructure, deployment workflows, model serving, platform tooling, automation, and production reliability. Training deployment is a core focus, and experience with inference deployment is a strong plus. We care about engineering judgment, technical depth, communication, and the ability to turn messy ML workflows into stable platform capabilities.

Requirements

• Strong software engineering and infrastructure fundamentals, with experience owning production or near-production systems.
• Practical experience with PyTorch and ML training workflows, including job orchestration, compute environments, artifact management, and deployment automation.
• Solid understanding of heterogeneous computing and high-performance computing, especially for ML training or serving workloads.
• Good understanding of model lifecycle concerns: data, configs, checkpoints, artifacts, reproducibility, rollout, rollback, and observability.
• Ability to build reliable platform abstractions without hiding the important details ML practitioners need to control.
• Clear technical and product sense: you can prioritize platform work that unlocks real training or deployment velocity.
• High standards for engineering quality, including tests, documentation, debugging tools, and maintainable system design.

Nice To Haves

• Experience building training deployment systems, model release workflows, or ML platform tooling for research and production teams.
• Experience with inference deployment, model serving, online/offline evaluation, performance tuning, or rollout safety.
• Experience with distributed training, GPU infrastructure, workload scheduling, artifact/version management, or reproducibility tooling.
• Understanding of CUDA, GPU architecture, or low-level performance optimization.
• Experience with open-source inference and serving frameworks such as vLLM, TensorRT, Triton, or similar systems.
• Experience migrating ad hoc notebooks, scripts, or manual ML processes into reliable platform workflows.

Responsibilities

• Design, build, and evolve infrastructure for ML training workflows, training deployment, experiment execution, and production handoff.
• Build and maintain deployment paths for models, jobs, services, and supporting infrastructure across development and production environments.
• Improve reliability, scalability, observability, and developer experience for ML workflows and platform tools.
• Define interfaces, automation, metadata, artifacts, configuration, environment management, and lifecycle boundaries for ML systems.
• Collaborate with research, product, data, and engineering partners to translate incomplete ML workflow needs into maintainable systems.
• Support production usage by building clear operational tooling, debugging paths, and safe rollout mechanisms.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed