Machine Learning Infrastructure Engineer at early-stage private AI platform

Jack & Jill/External ATS • San Francisco, CA

7d

About The Position

Build the core infrastructure to serve thousands, then millions, of private, personalized AI models at scale. This role involves optimizing model serving performance for low latency and cost, and integrating a TEE-based privacy stack to ensure user data and models are exclusively accessible by the user, not even the company. Drive the foundational systems for a new era of personal AI.

Requirements

• Deep understanding of the machine learning stack, including transformer optimization and GPU performance.
• Ability to execute quickly in a fast-paced, early-stage startup environment.
• A missionary mentality, passionate about ensuring AI works for people.

Responsibilities

• Build infrastructure for deploying thousands to millions of personalized finetuned models.
• Monitor and optimize in-the-wild model serving performance for low latency and cost.
• Integrate with a TEE-based privacy stack to guarantee user data and model confidentiality.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed