Senior Staff Machine Learning Engineer, Agentic Systems - Moveworks
About The Position
Moveworks is seeking a Senior Staff Machine Learning Engineer to join their Agentic Systems team. This role is critical in building, optimizing, and scaling end-to-end machine learning systems, specifically focusing on distributed training and inference pipelines for Large Language Models (LLMs), model evaluation and monitoring frameworks, and LLM latency optimization. These frameworks are foundational for hundreds of ML and NLP models in production, serving millions of enterprise employees. The role involves solving challenges in service scalability and core algorithm optimization, collaborating closely with machine learning, data infrastructure, and core skill teams. The work directly impacts customer experience with AI and is crucial for the long-term scalability of the core AI product and the company. The position offers a high-impact, fast-moving role at the forefront of the AI transformation, backed by the global scale of ServiceNow and the agility of a high-growth company. The engineer will be responsible for building and productionizing ML infrastructure that runs state-of-the-art models.
Requirements
- US Citizenship or permanent resident status
- 12+ years of industry experience in Machine Learning, Infrastructure or related fields
- Experience with deep learning framework such as Pytorch or Huggingface or LLM serving frameworks such as vLLM or TensorRT-LLM.
- Experience with building and scaling end-to-end machine learning systems
- Experience building scalable micro services and ETL pipelines
- Expertise in Python and experience with performant language such as C++ or GoLang
- Bachelor's in Computer Science, Computer Engineering, Mathematics, or equivalent field.
- A love of research publications in the machine learning and software engineering communities
- Effective communicator with experience collaborating cross-functionally with other teams
Responsibilities
- Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models.
- Build abstractions to automate various steps in different ML workflows.
- Collaborate with cross functional teams of engineers, data analytics, machine learning experts, and product to build new features.
- Leverage your experience to drive best practices in ML and data engineering.
Benefits
- Flexible scheduling
- Remote work options
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
