Program Manager Jobs

About The Position

Requirements

• BS/MS in Computer Science, Engineering, or a related technical field.
• 8-10+ years of experience in technical program management, infrastructure, or SRE, with at least 3-5 years managing infra or platform-scale programs.
• Proven success delivering cross-functional infrastructure programs in B2B or enterprise environments where scalability, uptime, and performance are critical.
• Experience working closely with Infra, SRE, and ML/AI teams on distributed systems or data infrastructure.
• Strong understanding of cloud infrastructure (AWS, GCP, or Azure) including compute, networking, storage, and orchestration systems.
• Ability to structure complex multi-quarter infrastructure programs with clear milestones and measurable impact.
• Strong written and verbal communication and ability to manage through ambiguity, anticipate scaling challenges, and align teams across priorities.
• Builder mindset with focus on automation, reliability, and efficiency.

Nice To Haves

• Understanding of data pipelines, ML training workflows, and LLM runtime infrastructure is a plus.

Responsibilities

• Driving the company’s Infrastructure roadmap across Setup & Deployment, Runtime, Storage, and AI Infra.
• Leading cross-functional programs that improve scalability, reliability, cost efficiency, and developer velocity.
• Defining and orchestrating how Glean instances are deployed, upgraded, and monitored at scale.
• Partnering with AI and Data teams to evolve our ML pipelines, model training infrastructure, and LLM serving stack.
• Leading initiatives to improve observability, configuration management, and resource utilization.
• Coordinating capacity planning, infrastructure migrations, and performance optimization programs.
• Building clear visibility into infra cost drivers and partnering with finance and engineering leaders on optimization initiatives.
• Lead end-to-end infra programs spanning compute, networking, storage, orchestration, and AI workloads.
• Partner with Engineering to define standards for environment provisioning, deployment automation, and configuration governance.
• Develop and operationalize frameworks for runtime health, scaling, and disaster recovery.
• Drive consistency and automation across deployment orchestration systems.
• Establish clear metrics for reliability, performance, and cost efficiency.
• Coordinate cross-team delivery of high-impact programs such as data pipeline scalability, LLM infrastructure expansion, or infra observability improvements.
• Communicate program status and technical risks effectively to leadership and stakeholders.
• Continuously identify process or system bottlenecks, and drive automation to improve speed and reliability of infra operations.

Benefits

• competitive compensation
• Medical, Vision, and Dental coverage
• generous time-off policy
• opportunity to contribute to your 401k plan
• home office improvement stipend
• annual education and wellness stipends
• regular events
• healthy lunches daily