Senior Machine Learning Engineer, Agentic AI Harness & Quality - Moveworks

ServiceNow • Mountain View, CA

5d • Onsite

About The Position

Moveworks is seeking an experienced software engineer with machine learning expertise to join the Agentic AI Harness & Quality team. This role focuses on expanding Moveworks' agentic AI capabilities, enhancing user experiences, and improving the platform's AI performance. The team utilizes advanced tools like LLMs, multimodal foundation models, and hybrid vector databases, supported by a world-class annotation team for data creation. The role emphasizes achieving state-of-the-art AI performance in production, considering accuracy, quality, latency, and reliability. Successful engineers will design and maintain high-performing compound AI systems, contributing to the goal of building the world's best enterprise assistant platform in collaboration with Moveworks and ServiceNow teams.

Requirements

• Drive to ship product improvements with production-quality, fully unit-tested code and rigorously-evaluated updates to models, prompts, or other tunable system components.
• Ability to solve problems end-to-end with machine learning.
• Solid grasp of model evaluation fundamentals, especially for agent trajectories, text generation, text classification, and non-uniform sampling regimes.
• Attention to detail and high standard of data quality for training and especially evaluation datasets.
• Readiness to hit the ground running in a Mac development environment, programming in Python and/or Golang.
• Familiarity with deep learning architectures and algorithms and leading large language models.
• High degree of ownership.
• Drive to ship product improvements with production-grade code.
• Strong appetite for continuous incremental wins and completing challenging projects fast.
• High level of curiosity about engineering outside of immediate discipline and ongoing desire to learn and stay at the cutting edge of agentic AI.

Responsibilities

• Apply software engineering, machine learning, and compound AI system engineering to create lasting value for customers.
• Drive quality in agent behavior, increasing utility and decreasing misbehavior.
• Tackle challenges in AI harness engineering, including agent cognitive architecture, eval benchmark creation, context engineering, generative UI, dynamic agent orchestration, multimodal I/O, multilinguality, conversational memory management, reasoning strategies, abstractive summarization, grounding and verifiability for generated text, deployment safety, and self-learning.
• Read, discuss, and build on the latest ML/LLM research and open-source repositories and models.
• Research and develop innovative, scalable, and dynamic solutions to complex problems.
• Improve the agentic harness and its AI components using machine learning fundamentals and LLMs, evaluate them with experiments, and productionize solutions at scale.
• Partner with web and chat platform engineering teams to translate harness investments into user experiences.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed