Staff Machine Learning Engineer, Agentic AI Harness & Quality - Moveworks
About The Position
Moveworks is seeking an experienced software engineer with machine learning expertise to join their Agentic AI Harness & Quality team. This role will focus on expanding Moveworks' agentic AI capabilities, enhancing user experiences, and improving the platform's AI functionalities. The team utilizes advanced tools like LLMs, multimodal foundation models, and hybrid vector databases, supported by a world-class annotation team for dataset creation. The position emphasizes achieving state-of-the-art AI performance in production, considering not only accuracy and quality but also latency, reliability, and the overall end-to-end system performance. The work involves designing and maintaining high-performing compound AI systems, pushing the boundaries of agent reliability and customer value, and collaborating across Moveworks and ServiceNow to build the highest-performing enterprise assistant platform.
Requirements
- Drive to ship product improvements with production-quality, fully unit-tested code and rigorously-evaluated updates to models, prompts, or other tunable system components.
- Ability to solve problems end-to-end with machine learning.
- Solid grasp of model evaluation fundamentals, especially for agent trajectories, text generation, text classification, and non-uniform sampling regimes.
- Attention to detail and high standard of data quality for training and especially evaluation datasets.
- Readiness to hit the ground running in a Mac development environment, programming in Python and/or Golang.
- Familiarity with deep learning architectures and algorithms and leading large language models.
- Desire to work at a startup pace in a medium-sized company with a high degree of ownership.
- Drive to ship product improvements with production-grade code.
- Strong appetite for continuous incremental wins and completing challenging projects fast.
- High level of curiosity about engineering outside of immediate discipline and ongoing desire to learn and stay at the cutting edge of NLU & AI.
Responsibilities
- Apply software engineering, machine learning, and compound AI system engineering to create lasting value for all customers.
- Drive quality in agent behavior, increasing utility for end users and decreasing misbehavior in the customer business environment.
- Tackle challenges in AI harness engineering, including agent cognitive architecture, eval benchmark creation, context engineering, generative UI, dynamic agent orchestration, multimodal I/O, multilinguality, conversational memory management, reasoning strategies, abstractive summarization, grounding and verifiability for generated text, deployment safety, and self-learning.
- Read, discuss, and build on the latest ML/LLM research and open-source repositories and models.
- Research and develop innovative, scalable, and dynamic solutions to complex problems.
- Utilize knowledge of machine learning fundamentals and LLMs to improve the agentic harness and its AI components, evaluate them with experiments, and productionize solutions at scale.
- Partner closely with web and chat platform engineering teams to translate harness investments into delightful user experiences.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
