Machine Learning Engineer, Agentic AI Systems - Moveworks

ServiceNow•Mountain View, CA

23h

About The Position

Moveworks is seeking an experienced software engineer with machine learning expertise to join their NLU (natural language understanding) and agentic AI capabilities team. This role will focus on enhancing user experiences and improving Moveworks' generative and conversational AI capabilities platform-wide. The NLU team has access to modern NLP and NLG tools, including LLMs, multimodal foundation models, and hybrid vector databases, along with the infrastructure for fine-tuning, evaluating, and serving models in production. The team is data-centric and supported by a world-class annotation team for building error-free, inclusive, and privacy-preserving datasets. The role goes beyond model training to achieve state-of-the-art AI performance in production, encompassing accuracy, quality, latency, reliability, and the overall end-to-end user-facing system. Successful engineers are motivated by designing and evolving compound AI systems and their components, moving fast, solving challenging product and engineering problems, and pushing the envelope of customer value. The work will contribute to understanding enterprise issues and building a reliable copilot, in collaboration with other Moveworks functions.

Requirements

Drive to ship product improvements with production-quality, fully unit-tested code and rigorously-evaluated updates to models, prompts, or other tunable system components.
Ability to solve problems end-to-end with machine learning.
Solid grasp of model evaluation fundamentals, especially for text generation, text classification, and non-uniform sampling regimes.
Attention to detail and high standard of data quality for training and especially evaluation datasets.
Readiness to hit the ground running in a Mac development environment, programming in Python and/or Golang.
Knowledge of deep learning architectures and algorithms and leading large language models.
Desire to work at a startup pace in a medium-sized company with a high degree of ownership.
Drive to ship product improvements with production-grade code.
Strong appetite for continuous incremental wins and completing challenging projects fast.
High level of curiosity about engineering outside of immediate discipline and ongoing desire to learn and stay at the cutting edge of NLU & AI.

Responsibilities

Apply software engineering, machine learning, and compound AI system engineering to create lasting value for all customers.
Take on challenges in conversational agent domains, such as agent cognitive architecture iteration, multimodal agents, multilingual agents, conversational memory management, reasoning strategies (e.g., Tree of Thoughts / Graph of Thoughts).
Fine-tune LLMs for tool use and enterprise reasoning (including preference alignment with RLHF/RLAIF/DPO).
Develop agent evaluation strategies and active learning of exemplars for few-shot text classification.
Work on abstractive summarization, and grounding & verifiability for generated text.
Push the envelope of Moveworks' commitments to responsible AI, expanding infrastructure for ensuring models work equally well for all people.
Red-team models to ensure they behave safely and as intended, and maintain ML at the cutting edge of data privacy and security.
Use knowledge of machine learning fundamentals and LLMs to design new algorithms and architectures, evaluate them with small-scale experiments, and productionize solutions at scale.
Research and develop innovative, scalable, and dynamic solutions to hard problems.
Use the latest advances in machine learning and LLMs to enhance products and create delightful user experiences.
Spend time weekly reading, discussing, and potentially building models from the latest ML research and open-source code.