Head of AI Platform

Abridge•San Francisco, CA

56d

About The Position

Our generative AI-powered products bring joy back to the practice of medicine. As our offerings expand, we're looking for a Head of AI Platform to scale the infrastructure that powers them. This is a critical, high-leverage role requiring both people leadership, technical strategy, and ownership of key business outcomes. You will own the entire lifecycle of our AI Platform, ensuring its reliability, efficiency, scalability, and compliance. You'll own a key pillar of our technical organization, driving the technical direction and organization shaping how our models are trained, served, and managed in production.

Requirements

A strong technologist, with 10+ years of experience building high-performance distributed systems and 3+ years managing AI/ML-focused engineering teams.
Comfortable giving constructive feedback on technical designs and code reviews.
Skilled in building secure, compliant systems in major cloud platforms (GCP preferred, but other experience welcome).
Skilled at hiring and mentorship, with a track record of helping engineers grow their skills and careers.
Expertise with kubernetes, containers, model training and serving, GPU-based capacity planning, and building applications on top of LLMs.
Knowledgeable about the software development lifecycle. You view processes such as Kanban and Scrum as tools in a toolbox, and you know which tools to apply in which situations.
Up-to-date on industry best-practices and tools, and enjoy learning new things
Excited about being hands-on in a fast-moving, productive, and supportive environment
Willing to pitch in wherever needed
Has thrived in a fast-growing startup, knows how to operate in that environment

Nice To Haves

Has owned an Evaluation Platform for AI/ML models.
Has owned data engineering or core infrastructure.

Responsibilities

People Management: Recruit, retain, and mentor engineers and engineering managers. Provide regular feedback; create opportunities for career growth; and foster a culture of collaboration and excellence.
Technical & Organizational Leadership: Act as the people and technical leader for the AI Platform team. This includes owning the staffing and execution of the team, and driving work on model serving, training compute, agent serving platform, LLM gateway, and associated orchestration layers. You will guide architectural discussions and set top-level strategic direction for the company's AI/ML infrastructure.
Project Management: Work closely with stakeholders, including product managers, engineering managers, and AI/ML teams to plan, execute, and support multiple projects simultaneously. You will be responsible for the engineering process in the team and the output of the platform.
Platform Ownership: Own the design, build, and operation of the core AI platform components, including: Model serving and deployment infrastructure.
Compute and vendor management (e.g. GPU allocation).
MLOps pipelines and tooling.
Health, quality, and performance monitoring.
Training compute infrastructure.
LLM gateway and orchestration layers for agent serving.
Champion Quality: Set a high standard for your team including software quality; communication; collaboration; and compliance with industry and regulatory standards.

Benefits

Generous Time Off: 13 paid holidays, flexible PTO for salaried employees, and accrued time off for hourly employees.
Comprehensive Health Plans: Medical, Dental, and Vision plans for all full-time employees. Abridge covers 100% of the premium for you and 75% for dependents. If you choose a HSA-eligible plan, Abridge also makes monthly contributions to your HSA.
Paid Parental Leave: 16 weeks paid parental leave for all full-time employees.
401k and Matching: Contribution matching to help invest in your future.
Pre-tax Benefits: Access to Flexible Spending Accounts (FSA) and Commuter Benefits.
Learning and Development Budget: Yearly contributions for coaching, courses, workshops, conferences, and more.
Sabbatical Leave: 30 days of paid Sabbatical Leave after 5 years of employment.
Compensation and Equity: Competitive compensation and equity grants for full time employees.
... and much more!

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume