AI Engineer

Modern Relay•New York City, NY

About The Position

Modern Relay is building a knowledge platform for companies where people work alongside internal and external AI agents. The platform provides a shared layer of truth that people and agents can use to contribute knowledge, propose updates, and trigger workflows. The AI Engineer will build the data and model foundations needed to make the platform reliable in production, working across data pipelines, model development, and ML infrastructure. The role involves turning messy signals into structured knowledge and high-quality model behavior, and building end-to-end systems spanning schema design, data infrastructure, model training and evaluation, and feedback loops. The role can be based in San Francisco, New York City, Barcelona, or remotely in the U.S. or Europe.

Requirements

  • 0–6 years of experience in AI/ML engineering, data engineering, or a closely related role; exceptional new graduates with strong projects are welcome.
  • Strong fundamentals in data engineering, including pipelines, data modeling, schema design, and data quality practices.
  • Experience building or operating production ML systems, including training, evaluation, deployment, and monitoring, or strong evidence of being able to ramp up quickly.
  • Comfort working across the stack, from raw data and infrastructure to model behavior and product integration.
  • Familiarity with modern ML platforms and tooling, such as experiment tracking, dataset versioning, orchestration, feature or data stores, and model serving.
  • Understanding of information theory concepts such as entropy and mutual information, and how they relate to signal, compression, and evaluation.
  • High ownership and a bias toward shipping; ability to take ambiguous problems, propose a plan, and execute.

Nice To Haves

  • Experience with knowledge graphs or structured knowledge representations.

Responsibilities

  • Design and build pipelines that ingest, clean, and transform product and customer data into high-signal training and evaluation datasets.
  • Own data infrastructure decisions, including storage, orchestration, lineage, and observability, to support reliability, scalability, and fast iteration.
  • Develop and improve ML and AI systems for agent task-solving, including retrieval, ranking, classification, and structured extraction.
  • Create and maintain schemas for agent memory, tool outputs, and conversation artifacts to support consistent modeling and analytics.
  • Build evaluation harnesses and metrics to measure model quality, regressions, and real-world performance offline and online.
  • Work with knowledge representations such as knowledge graphs to connect entities, events, and business context for improved reasoning and retrieval.
  • Partner with Product and Engineering to integrate models into production workflows with clear SLAs and monitoring.
  • Improve feedback loops through labeling strategies, active learning, error analysis, and dataset and version management.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service