Senior Software Engineer, Agentic AI Platform - Moveworks

ServiceNow • Mountain View, CA

6d

About The Position

Moveworks is seeking a Senior Software Engineer to join their Conversation Engine team. This role involves scaling and optimizing a cutting-edge Generative AI product that provides instant assistance to enterprise users. The engineer will work at the core of Moveworks' Generative AI product, focusing on scaling and optimizing it for the enterprise solution space. The company encourages innovative ideas and imagination to solve unsolved problems, with collaboration among machine learning experts and cross-functional teams. The challenge includes scaling and optimizing the conversation engine to support hundreds of millions of users across multiple chat channels and use cases, and enhancing the end-to-end product infrastructure with high engineering quality and robustness.

Requirements

• A strong foundation in computer science and software engineering, coupled with expertise in building scalable systems.
• A deep understanding of clean, modular, and scalable API design.
• The ability to champion best coding practices and influence fellow engineers to uphold high standards of code quality and craftsmanship.
• A passion for optimizing systems and improving performance.
• Well-versed in tracing, logging, and metrics frameworks, and possess a systematic approach to quickly identify and resolve latency bottlenecks, race conditions, and throughput limitations.
• The ability to independently research new requirements and develop innovative solutions.
• Thrive in an environment of fast-paced coding and execution, embracing rapid iterations to deliver results.
• Strong communication skills to effectively articulate rationales and design approaches.
• Cross-functional awareness that enables seamless collaboration with various teams.
• A bachelor's degree or higher in computer science or a related field.
• 5+ years of professional development experience, specifically in building systems at scale.

Responsibilities

• Construct an extensive product infrastructure, complete with user-friendly interfaces that empower engineers and configurators to effortlessly customize and optimize generative AI models.
• Collect data and feedback, adapting to diverse enterprise use cases and business contexts, and delivering domain-specific conversational experiences.
• Design scalable API abstractions for our conversation platform, which supports all popular chat clients (for example, MSTeams, Slack, and Web) and offers a neutral API for developing other parts of the engineering system.
• Optimize the dialog engine to accommodate a wide range of conversational features, leveraging private domain knowledge unique to each enterprise customer in the cloud, and enable real-time multilingual translation.
• Achieve optimization with minimal memory footprint, low latency, and a streamlined development process for application engineers.
• Champion the best practices for coding patterns, API design, scalability, robustness, and optimization.
• Foster a culture of excellence and continuous improvements among fellow engineers.
• Provide comprehensive insights and visibility into the performance of our conversational AI product by implementing a robust logging and tracing framework, user-friendly debugging and triaging tools, and automated metrics for efficient monitoring and analysis.
• Collaborate closely with ML engineers, application engineers, product teams, and customer support teams to drive the development of new features and scalability initiatives.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior