AI Enterprise Engineer

Bespoke Labs • Mountain View, CA

83d

About The Position

Bespoke Labs is looking for AI Enterprise Engineers who will work directly with Enterprise customers, owning strategy and execution. The role involves defining model and agent specifications, understanding user pain points, and designing specialized agents. Responsibilities include benchmarking models and creating datasets tailored to customer needs using Bespoke Labs tools. The position also requires improving model performance through context optimization and post-training techniques such as SFT and RL. The role emphasizes the importance of research, as Bespoke Labs contributes to core research in AI, including prompt optimization techniques like GEPA. AI engineers at Bespoke Labs combine research intuition with practical execution, needing to understand agent behavior, identify reward hacking, and analyze failure modes to translate that understanding into specialized agents deployed in enterprise settings.

Requirements

• Experience in Python and ML product development.
• Strong background in Computer Science or Electrical and Computer Engineering, with an MS/PhD degree preferred.
• Demonstrated experience in ML and AI fundamentals, including model evaluation, training, and fine-tuning.
• Experience deploying models in production.

Nice To Haves

• Experience and publications in top AI venues such as NeurIPS, ICML, ICLR.
• A continuing curiosity for research and publication.

Responsibilities

• Work directly with Enterprise customers to own strategy and execution.
• Define model and agent specifications based on customer needs.
• Understand user pain points and design specialized agents accordingly.
• Benchmark models and create datasets using Bespoke Labs tools.
• Improve model performance through context optimization and post-training techniques like SFT and RL.
• Contribute to core research in AI, including prompt optimization techniques.
• Analyze agent behavior, identify reward hacking, and assess failure modes.

What This Job Offers

• Career Level: Mid Level
• Education Level: Master's degree