AI Systems Engineer

Sagora•Boston, MA

About The Position

Sagora is hiring an AI Systems Engineer to help transform computer systems design and optimization with AI. The role combines systems engineering with enthusiasm for AI as a collaborator and tool for discovering new ideas in computer and networked systems. The engineer will design, build, and ship early versions of Sagora’s product, working closely with the founders and engineering team to turn research into production systems. The work includes building components of an AI-driven optimization stack and establishing the engineering foundations for a high-velocity team. Sagora was founded by MIT CSAIL professors and former PhD students, is based on a decade of research, and describes its product as an autonomous engineering platform for AI systems. Its agents diagnose problems, form hypotheses, run experiments, and ship validated production-ready code to improve customers’ AI model, pipeline, and inference performance, cost, and quality. The company is headquartered in Boston, backed by $13.5 million in seed funding, and reports production deployments at multiple S&P 500 companies.

Requirements

  • Strong systems intuition, intellectual curiosity, and a desire to embrace AI-driven engineering.
  • Strong Python and PyTorch fundamentals.
  • Comfort building large-scale, high-performance distributed systems.
  • Appreciation for disciplined engineering rigor and preference for avoiding rigid bureaucratic processes.

Nice To Haves

  • Experience with AI inference, distributed serving, model optimization, or related topics.
  • Hands-on experience with vLLM, PyTorch, Triton Inference Server, Ray Serve, or other inference frameworks.
  • Experience with GPU optimization, kernel design, CUDA programming, or low-level systems performance engineering.
  • PhD or equivalent experience; the posting describes a PhD or equivalent plus approximately five years of experience as a good sweet spot.

Responsibilities

  • Design, build, and deploy core components of Sagora’s AI-driven optimization stack.
  • Work with the founders to translate research insights into usable systems.
  • Own critical platform components, including routing, scheduling, autoscaling, hardware selection, and inference engine integrations.
  • Build prototypes, validate them, and iterate based on user and customer feedback.
  • Help establish technical architecture, coding standards, and engineering best practices.
  • Set up development workflows, infrastructure, tooling, and deployment pipelines.
  • Evaluate third-party tools and services and make build-versus-buy decisions.
  • Document design and development work and help establish a foundation for future engineering hires.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service