Software Engineer, AI Infrastructure

Glean•San Francisco, CA

2d•Hybrid

About The Position

Glean is looking for software engineers to help build the world's best search and assistant product for work. Our engineers work on a range of systems across the stack, including generative AI, RAG, query understanding, document understanding, domain-adapted language models, natural language question-answering, evaluation, and experimentation. We interact regularly with customers, deeply understand their pain points, and use whatever tool is necessary, simple or complex, to solve their problems.

Requirements

2-5 years of experience
BA/BS in computer science, math, sciences, or a related degree
Proven ability to design, build, and ship production-ready software, ideally around AI/ML infrastructure (Batch processing pipelines, Serving infrastructure, LLM orchestration etc.)
Strong coding skills (Python, Go, Java)
Thrive in a customer-focused, tight-knit and cross-functional environment — being a team player and willing to take on whatever is most impactful for the company is a must
A proactive and positive attitude to lead, learn, troubleshoot and take ownership of both small tasks and large features

Responsibilities

Design, build, and improve AI/ML systems and data pipelines infrastructure, including platforms that power large language model serving, routing, and orchestration at scale.
Work with and enable other engineers focused on modeling and Agentic capabilities
Build agentic systems that leverage AI to proactively monitor, diagnose, debug and maintain infrastructure health at scale across cloud deployments
Write robust code that's easy to read, maintain, and test
Mentor more junior engineers, or learn from battle-tested ones