Applied AI Scientist

Obin AI•New York, NY
•Hybrid

About The Position

Obin AI is hiring an Applied AI Scientist for its platform team to develop evaluation tooling for its AI agents, called Robins, which handle regulated financial-services workflows. The role focuses on determining whether agents produce correct results at every step, not merely on average, and integrating evaluations into the Obin platform so they run with every release. The scientist will design evaluations, build shared evaluation, monitoring, and feedback tools used across teams, and improve agent performance through prompt and context optimization and adapter tuning where appropriate. The role works with the platform engineering team, company founders, and forward deployed engineers who deploy Robins into customer workflows. It is a mid-level individual-contributor position based in New York with a hybrid work arrangement.

Requirements

  • At least 4 years of experience in data science, applied machine learning, or machine learning engineering.
  • Hands-on experience designing and evaluating LLM-based applications.
  • Experience building with models rather than training them, using techniques such as ReAct, ensembling, and multi-step reasoning.
  • Ability to write production-quality Python.
  • Use of AI tools in day-to-day work.
  • Ability to explain a statistical result to an executive in two sentences.

Nice To Haves

  • Experience in financial systems, risk modeling, or decision automation.
  • Familiarity with machine learning training and deployment.
  • Experience with GCP, which is listed as preferred.
  • Familiarity with PydanticAI, LlamaIndex, Google ADK, Claude Agent SDK, or similar frameworks and tools.

Responsibilities

  • Design evaluations that assess whether an AI agent is correct at each step.
  • Build evaluation tooling into the Obin platform so evaluations run on every release.
  • Develop shared evaluation, monitoring, and feedback tooling that teams use to measure their agents consistently.
  • Improve agent performance through prompt and context optimization, and adapter tuning where appropriate.
  • Collaborate with the platform engineering team, founders, and forward deployed engineers.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service