Technical Lead, ML Infrastructure

Gatik AI•Santa Clara, CA
•$180,000 - $260,000

About The Position

Gatik is seeking a hands-on technical leader to set the direction for its Scalable ML team and build alongside its engineers. The role owns the architecture for turning fleet and simulation data into training and evaluation sets, scaling model training and evaluation, and supporting release decisions with rigorous metrics. The lead will spend substantial time designing systems, writing production code, and reviewing critical changes, while also leading engineers and coordinating with platform teams. The Scalable ML team develops data generation, curation, orchestration, and distributed training infrastructure so machine learning developers can work effectively with real-world fleet data and simulated driving scenarios. It works across ML Platform, Jobs Platform, Cloud Platform, and High Performance Computing, in close partnership with autonomy, simulation, safety, and data teams. The position sets multi-quarter technical strategy; builds and operates reproducible, scalable data and ML pipelines; establishes MLOps, dataset quality, metrics, and reliability standards; mentors and guides engineers; and represents the team in cross-team architecture and planning decisions. The work supports safety-critical autonomous freight systems.

Requirements

  • Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, Robotics, or a related field and 8+ years of relevant industry experience, or a Master’s degree and 6+ years of relevant industry experience.
  • At least 2 years as a technical lead, Staff engineer, or in a similar role guiding other engineers.
  • Expert Python software engineering skills and a record of continuing to write and ship production-quality, high-performance code as a leader.
  • Deep experience building end-to-end ML systems from data pipelines and dataset curation through training, evaluation, and production, using tools such as SQL, pandas, PyTorch, or scikit-learn.
  • Hands-on production experience with Ray (Ray Core, Ray Data, Ray Train, and/or Ray Tune), including running and debugging Ray workloads at scale.
  • Deep experience with PyTorch and PyTorch Lightning for large-scale training, including distributed strategies such as DDP or FSDP, mixed precision, and checkpointing.
  • Extensive experience designing and operating large-scale distributed systems and cloud infrastructure for ML, including shared-compute environments with GPU scheduling and quota, job orchestration, and multi-tenant clusters.
  • Solid grounding in statistics and experimental design, including selecting evaluation strategies, metrics, and thresholds for real-world decisions.
  • Track record of setting technical direction across a team or multiple teams and delivering complex cross-team initiatives from conception to production.
  • Demonstrated ability to influence and align peer teams and leaders without direct authority.
  • Clear communication skills and ability to mentor engineers and work effectively across software, ML, and autonomy teams.

Responsibilities

  • Define and own multi-quarter technical strategy for data generation, curation, orchestration, and distributed training, coordinating with ML Platform, Jobs Platform, Cloud Platform, and HPC roadmaps.
  • Design and build challenging parts of the stack, prototype approaches, and establish standards for code quality, testing, type checking, and code review through hands-on work.
  • Design reproducible pipelines to discover, label, and organize fleet and simulation driving scenarios, with versioning, provenance, train/validation/holdout splits, and clear data contracts.
  • Guide creation of balanced training and evaluation datasets that cover routes, weather, and traffic conditions; use coverage and label-quality analysis to inform dataset and model priorities.
  • Lead design of distributed training, inference, and evaluation pipelines, including data loading, checkpointing, and experiment tracking on multi-tenant GPU clusters.
  • Establish MLOps standards for model artifacts, experiment tracking, automated model testing, and deployment across Gatik.
  • Define implementation and validation of model and release metrics, and ensure experiments, baselines, ablations, and uncertainty estimates meet the rigor required for safety-critical release decisions.
  • Break down ambiguous work, guide technical decisions, mentor engineers through design and code review, and develop team capabilities in scalable ML infrastructure.
  • Represent Scalable ML in architecture and planning discussions and resolve shared-infrastructure tradeoffs with peer leads, including GPU scheduling and quota, job orchestration, storage, and compute cost.
  • Maintain high reliability standards and lead incident root-cause analysis, fixes, and prevention, including incidents that cross team boundaries.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service