Machine Learning Engineer, Agentic AI Harness & Quality - Moveworks

ServiceNow•Mountain View, CA

5d•$139,700 - $216,500•Onsite

About The Position

Moveworks is seeking an experienced software engineer with machine learning expertise to join their Agentic AI Harness & Quality team. This role will focus on expanding Moveworks' agentic AI capabilities, enhancing user experiences, and improving the platform's AI performance. The team utilizes advanced LLMs, multimodal foundation models, and hybrid vector databases, supported by a world-class annotation team for data curation. The engineer will be responsible for achieving state-of-the-art AI performance in production, encompassing accuracy, quality, latency, and reliability. The role involves applying software engineering, machine learning, and compound AI system engineering to drive quality in agent behavior, tackle complex challenges in conversational agent domains, and advance responsible AI commitments. The work will directly impact the objective of building a high-performing enterprise assistant platform, in collaboration with other Moveworks and ServiceNow functions.

Requirements

Drive to ship product improvements with production-quality, fully unit-tested code and rigorously-evaluated updates to models, prompts, or other tunable system components
Ability to solve problems end-to-end with machine learning
Solid grasp of model evaluation fundamentals, especially for text generation, text classification, and non-uniform sampling regimes
Attention to detail and high standard of data quality for training and especially evaluation datasets
Readiness to hit the ground running in a Mac development environment, programming in Python and/or Golang
Knowledge of deep learning architectures and algorithms and leading large language models
Desire to work at a startup pace in a medium-sized company with a high degree of ownership
Drive to ship product improvements with production-grade code
Strong appetite for continuous incremental wins and completing challenging projects fast
High level of curiosity about engineering outside of immediate discipline and ongoing desire to learn and stay at the cutting edge of NLU & AI

Responsibilities

Apply software engineering, machine learning, and compound AI system engineering to create lasting value for all our customers
Drive quality in agent behavior, both in terms of increasing utility for end users and decreasing misbehavior in the customer business environment
Take on exciting and difficult challenges in conversational agent domains, such as agent cognitive architecture, generative UI, dynamic agent orchestration, multimodal I/O, multilingual agents, conversational memory management, reasoning strategies, agent evaluation, abstractive summarization, grounding and verifiability for generated text, and self-learning
Push the envelope of Moveworks commitments to responsible AI, expanding our infrastructure for ensuring models work equally well for all people, red-teaming models to ensure they behave safely and as intended, and keeping our ML at the cutting edge of data privacy and security
Use your knowledge of machine learning fundamentals and LLMs to make improvements to the agentic harness and its AI components, evaluate them with small scale experiments and productionize your solutions at scale
Research and develop innovative, scalable and dynamic solutions to hard problems
Use the latest advances in machine learning and LLMs to enhance our products and create delightful user experiences
Read, discuss, and build on the latest ML research and open-source code