Senior Machine Learning Engineer, Agentic Systems - Moveworks

ServiceNow • Mountain View, CA

11h

About The Position

Moveworks is seeking a Machine Learning Engineer to help build cutting-edge ML infrastructure for building and serving LLMs at Moveworks. This role is critical in building, optimizing, and scaling end-to-end machine learning systems. The ML infra team is responsible for distributed training and inference pipelines for large language models (LLMs), model evaluation and monitoring frameworks, and LLM latency optimization. These frameworks form a strong foundation for hundreds of ML and NLP models in production, serving hundreds of millions of enterprise employees. The team tackles challenges in service scalability and core algorithm optimization. The role involves close collaboration with machine learning, data infrastructure, and core skill teams, with the work directly impacting customer experience with AI and the long-term scalability of the core AI product. The position is responsible for building and productionizing ML infrastructure that runs state-of-the-art models, offering a high-impact, fast-moving role for career advancement.

Requirements

• 5+ years of industry experience in Machine Learning, Infrastructure or related fields.
• Experience with deep learning frameworks such as Pytorch or Huggingface or LLM serving frameworks such as vLLM or TensorRT-LLM.
• Experience with building and scaling end-to-end machine learning systems.
• Experience building scalable microservices and ETL pipelines.
• Expertise in Python and experience with performant languages such as C++ or GoLang.
• Bachelor's in Computer Science, Computer Engineering, Mathematics, or equivalent field.
• A love of research publications in the machine learning and software engineering communities.
• Effective communicator with experience collaborating cross-functionally with other teams.

Responsibilities

• Design, build and optimize scalable machine learning infrastructure to support training, evaluation, and deployment of large language models.
• Build abstractions to automate various steps in different ML workflows.
• Collaborate with cross-functional teams of engineers, data analytics, machine learning experts, and product to build new features.
• Leverage experience to drive best practices in ML and data engineering.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior