Staff Software Engineer - Infrastructure, Machine Learning

Baton Trucking•San Francisco, CA

52d•$250,000 - $330,000•Hybrid

About The Position

As a Staff Software Engineer within our Machine Learning Team, you will tackle complex challenges in distributed systems and ML operations to enhance our machine learning infrastructure. You'll build scalable ML infrastructure from the ground up - supporting model deployment, distributed training, real-time inference, and more. You'll be a key partner to the Data Science team, helping bring value to production quickly and reliably. This role requires a blend of advanced Python programming skills within production environments and expertise in distributed computing.

Requirements

Production Python & Distributed Systems Expertise
Advanced proficiency in Python at a Staff Level
Must be within a production environment where the code directly impacts operations.
Experience in distributed computing, scalable ML infrastructure, & high-performance engineering.
Machine Learning (MLOps)
Scales ML infra for multiple teams and use cases.
Experience implementing and serving ML algorithms.
Ensures reproducibility, lineage, and experiment rigor.
Owns end-to-end ML systems: training, deployment, features, monitoring, rollback.
Hands-on experience with data engineering, distributed training, model monitoring, and experiment tracking.
Breadth of knowledge and applied experience across multiple ML applications, with proven ability to leverage a wide range of tools, frameworks, and systems.
Technical Leadership & Cross-Functional Influence
Leads design and delivery of large-scale ML or distributed systems.
Defines reusable patterns, standards, and architectures.
Drives decisions that improve reliability, latency, and developer velocity.
Sets technical direction and elevates ML engineering standards.
Communicates vision and trade-offs across disciplines.
Can Mentor other ML engineers on the team.

Nice To Haves

5 to 8 years of backend or ML infrastructure experience.
Proven track record building production ML workflows at scale.
Experience in industry logistics, transportation, or freight is a bonus.

Responsibilities

Own Core ML Infrastructure:
Build and scale distributed systems for ML training, serving, and inference.
Design and implement real-time ML workflows that power core product features.
Implementation of Distributed Systems:
Build robust distributed systems tailored for efficient ML training and seamless operational deployment.
Feature Engineering Enhancement:
Streamline and manage both online and offline feature stores, optimizing feature engineering processes for greater efficiency.
Real-Time ML Workflow Enhancement:
Improve real-time machine learning workflows to support dynamic decision-making and automate core operational processes.
Platform Level Ownership:
Lead the development of ML Ops systems, including model deployment, monitoring, and experiment tracking.
Architect and manage scalable feature stores for online and offline usage.
AI-Driven Optimization:
Contribute to agentic AI systems for freight matching, ETA prediction, and load scheduling.
Support systems that improve Stop Estimation Accuracy and Cross-Mode Optimization.
Production Ready Engineering:
Write production-grade Python that operates at scale, with reliability and performance top of mind.
Collaborate across engineering and data science to turn models into resilient software systems.