Staff Software Engineer, Agentic App Platform - Moveworks

ServiceNow•Mountain View, CA

43d•$176,100 - $308,200•Onsite

About The Position

The Staff Software Engineer will work on the Conversation Engine team, scaling and optimizing Moveworks’ generative AI product for enterprise users. The role focuses on building robust product infrastructure for a dynamic conversational system that can support hundreds of millions of users across chat channels and use cases. The engineer will collaborate with machine learning experts and cross-functional teams, rapidly iterate on new ideas, and use user behavior data to guide decisions. The position involves developing tools and interfaces that let engineers and configurators customize and optimize generative AI models for different enterprise contexts, and designing scalable, channel-neutral APIs for the conversation platform. It also includes improving the dialog engine to support enterprise-specific knowledge and real-time multilingual translation while minimizing memory use and latency. The role promotes high standards in API design, code quality, scalability, and optimization, and builds observability and debugging capabilities for monitoring and analyzing conversational AI performance.

Requirements

Strong foundation in computer science and software engineering, with expertise in building scalable systems.
Deep understanding of clean, modular, and scalable API design.
Ability to champion coding best practices and influence engineers to maintain high standards of code quality and craftsmanship.
Passion for system optimization and performance improvement.
Experience or knowledge with tracing, logging, and metrics frameworks, and a systematic approach to identifying and resolving latency bottlenecks, race conditions, and throughput limitations.
Ability to independently research requirements and develop innovative solutions in a fast-paced environment with rapid iteration.
Strong communication skills for explaining rationales and design approaches, and cross-functional awareness to collaborate with various teams.
Bachelor’s degree or higher in computer science or a related field.
At least 7 years of professional development experience building systems at scale.

Responsibilities

Build product infrastructure and interfaces that enable engineers and configurators to customize and optimize generative AI models, collect data and feedback, adapt to enterprise use cases, and deliver domain-specific conversational experiences.
Design scalable API abstractions for the conversation platform, supporting popular chat clients such as Microsoft Teams, Slack, and web clients, as well as a neutral API for other engineering systems.
Optimize the dialog engine to support conversational features, enterprise-specific private domain knowledge, and real-time multilingual translation while minimizing memory footprint and latency and streamlining application development.
Promote best practices in coding patterns, API design, scalability, robustness, and optimization, and foster engineering excellence and continuous improvement.
Implement logging and tracing frameworks, debugging and triaging tools, and automated metrics to provide visibility into product performance and support monitoring and analysis.
Collaborate with machine learning engineers, application engineers, product teams, and customer support teams on new features and scalability initiatives.