Sr. Staff Software Engineer - AI Chat
About The Position
ChatNow is how Lilly talks to AI. Every day, tens of thousands of employees open ChatNow to get work done — asking questions, running analyses, invoking specialized agents. It's the front door to Cortex, Lilly's enterprise AI platform. And it needs to be fast, intuitive, and relentlessly reliable. We're looking for a Senior Staff Software Engineer to own the technical direction and delivery of ChatNow's core platform: the routing engine that matches intent to the right agent, the integration layer that connects a growing ecosystem of AI capabilities, and the experience layer that makes it all feel effortless. You'll set the technical bar for one of Lilly's most visible AI products — and ship code that the entire company uses every day.
Requirements
- 10+ years of professional software engineering experience, with demonstrated technical leadership at scale
- 5+ years in TypeScript/JavaScript, Python and Go (with ability to use AI coding tools proficiently), architecting and building production web applications with React or equivalent
- 5+ years experience designing RESTful or GraphQL APIs at scale
- Deep hands-on experience with Kubernetes — not just deploying, but operating, debugging, and tuning
- Strong CI/CD and GitOps practices
- Bachelor's degree in Computer Science, Software Engineering, or a related field
Nice To Haves
- Experience integrating LLM APIs into production — streaming, function calling, tool use
- Hands-on work with conversational AI systems: routing, intent classification, context management, or multi-agent orchestration
- Experience with real-time systems: WebSockets, SSE, event-driven architectures, or workflow orchestration
- Familiarity with MCP, A2A, or emerging AI interoperability protocols
- Active use of agentic coding tools in your daily workflow
- A track record of shipping user-facing products with high reliability and polish
- Experience setting technical direction across multiple teams or workstreams
Responsibilities
- Define the architecture and drive implementation of ChatNow's conversation routing engine — the system that takes a user's intent and connects it to the right AI agent, model, or workflow.
- Own the agent integration layer, designing how ChatNow connects to Lilly's expanding network of specialized AI agents on Cortex.
- Build streaming chat interfaces in React and TypeScript, backed by scalable services that handle thousands of concurrent sessions with low latency across multiple AI providers.
- Own features end to end: Design, build, test, deploy, monitor.
- Operate ChatNow on Cortex and Hangar — Lilly's enterprise Kubernetes platform — instrumented with LGTM observability so you can see exactly how routing, latency, and agent performance behave in production.
- Integrate LLM capabilities through Cortex's model gateway, supporting multi-model routing with fallback and load balancing.
- Implement MCP integrations that connect agents to enterprise data sources and tools.
- Use agentic coding tools like Claude Code and GitHub Copilot as a daily force multiplier.
- Shape how agents are registered, discovered, and invoked on Cortex — defining the framework that the rest of the organization builds on.
- Make technical decisions that ripple across teams, mentor engineers, and raise the standard for what production AI software looks like at Lilly.
Benefits
- company bonus (depending, in part, on company and individual performance)
- company-sponsored 401(k)
- pension
- vacation benefits
- medical, dental, vision and prescription drug benefits
- flexible benefits (e.g., healthcare and/or dependent day care flexible spending accounts)
- life insurance and death benefits
- certain time off and leave of absence benefits
- well-being benefits (e.g., employee assistance program, fitness benefits, and employee clubs and activities)
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
