Staff Software Engineer- Agentic AI - Federal

ServiceNow•Santa Clara, CA
•Hybrid

About The Position

ServiceNow is hiring a Staff Software Engineer to independently lead the design, development, and delivery of complex, high-impact AI-native and cloud-native systems. The role owns critical components and features, sets technical direction within its domain, and provides technical guidance to peers and junior engineers. It combines deep software engineering fundamentals with hands-on AI/ML integration, cloud architecture, and production-systems experience, while balancing technical depth with organizational impact across teams. This flexible hybrid role is based in Santa Clara, California, and requires working from the Santa Clara office two days per week. The position supports US Regulated Markets and requires passing the ServiceNow USFedPASS background screening, which includes credit and criminal/misdemeanor checks and a drug test. Due to federal requirements, candidates must be US citizens, naturalized US citizens, or US permanent residents holding a green card.

Requirements

  • 8+ years of software development experience with a bachelor's degree; or 6+ years with a master's degree; or 3+ years with a PhD; or equivalent work experience.
  • 5+ years of practical software development experience with modern cloud-native and AI-native systems.
  • 3+ years of hands-on experience with LLM prompt engineering, agent design, and retrieval systems such as RAG, semantic search, or knowledge bases.
  • 3+ years of experience integrating third-party AI/ML services and platform APIs.
  • 2+ years of hands-on experience developing applications and extensions on the ServiceNow platform.
  • Strong proficiency in JavaScript/GlideScript, Python, and Java, with familiarity with ServiceNow scripting patterns and APIs.
  • Understanding of the ServiceNow data model, form and workflow design, and business process automation.
  • Understanding of microservices architecture, REST and streaming APIs, and backend frameworks such as Spring Boot or FastAPI.
  • Experience designing and optimizing high-performance data pipelines, embedding systems, and vector stores at scale.
  • Expertise with LLM orchestration frameworks such as LangChain, LlamaIndex, or Semantic Kernel, and vector databases such as Pinecone, Weaviate, or pgvector.
  • Experience with AWS, GCP, or Azure cloud platforms and managed AI services; hands-on infrastructure-as-code experience.
  • Proficiency with Kubernetes, containerization, CI/CD pipelines, and automated testing frameworks.
  • Experience developing and debugging evaluation harnesses, benchmarks, and metrics for AI/ML features.
  • Ability to troubleshoot and isolate root causes in complex, distributed, and probabilistic systems.
  • Strong communication skills and ability to explain technical concepts to technical and non-technical audiences.
  • Experience with Agile and Scrum methodologies and iterative development.
  • Ability to engage with customers, understand their needs, and support issue resolution.
  • Track record of owning and successfully delivering significant technical initiatives.
  • Demonstrated mentorship of junior engineers or technical leadership in previous roles.
  • Must meet the stated US citizenship or permanent residency requirement and pass the required USFedPASS screening.

Nice To Haves

  • Customer-facing experience.

Responsibilities

  • Lead the design and architecture of production-critical AI-native systems, including LLM integrations, agentic workflows, retrieval pipelines, and inference services.
  • Own end-to-end delivery of medium-to-large features or systems, from specification and design through implementation, testing, deployment, and production monitoring.
  • Make architectural and technical trade-offs involving latency, cost, scalability, reliability, and model quality.
  • Establish evaluation frameworks, testing strategies, and production monitoring for AI-driven features, and promote eval-driven development.
  • Design and optimize high-performance data pipelines, embedding systems, and vector stores for large-scale retrieval scenarios.
  • Promote security practices covering prompt-injection defense, data privacy, PII handling, responsible AI guardrails, and regulatory compliance.
  • Participate in cross-team architectural reviews and platform-level technical decisions; evaluate emerging AI/ML technologies for potential adoption.
  • Mentor junior and mid-level engineers through pair programming, design reviews, architecture discussions, and hands-on coaching.
  • Review code, prompts, agent logic, retrieval strategies, and AI/model behavior; identify technical debt and lead improvement initiatives.
  • Share knowledge through documentation, brown-bag sessions, and architectural guidance; contribute to hiring, interviews, and onboarding.
  • Collaborate with product management, domain specialists, and engineering teams to define requirements and technical specifications.
  • Explain technical concepts and AI trade-offs to non-technical stakeholders, and communicate design decisions, challenges, limitations, and incidents.
  • Lead root cause analysis of customer issues involving model behavior, hallucinations, retrieval quality, or distributed-system complexity.
  • Develop robust, maintainable, well-tested AI-native software using Python, Java, and JavaScript as appropriate.
  • Build unit tests, integration tests, and AI evaluation harnesses for accuracy, regression, and hallucination detection.
  • Troubleshoot distributed systems, probabilistic models, and cloud infrastructure; implement secure coding and responsible AI practices.
  • Deploy, monitor, and iterate on production features, responding to performance issues and model drift.
  • Work with cloud services, managed AI services, Kubernetes, and CI/CD pipelines; contribute to code and architecture standards.
  • Design and develop ServiceNow applications, extensions, integrations, workflows, business rules, automations, data models, forms, and dashboards.
  • Use ServiceNow scripting and APIs, integrate third-party AI/ML services, maintain plugin and application architecture, and support upgrades and configuration management.
  • Participate in customer issue triage and root cause analysis; work with customer success and support teams to resolve complex issues and escalations.
  • Guide customers on application usage, configuration, and troubleshooting; identify recurring issue patterns and drive improvements.
  • Contribute to customer documentation and internal knowledge bases, and share customer feedback and product improvement opportunities with product management.

Benefits

  • Health plans
  • Flexible spending accounts
  • 401(k) plan with company match
  • Employee Stock Purchase Plan (ESPP)
  • Matching donations
  • Flexible time away plan
  • Family leave programs
  • Equity, when applicable
  • Variable/incentive compensation
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service