Director, Model Inference Engineering

Thomson Reuters•Frisco, TX
•$212,100 - $393,900•Hybrid

About The Position

Thomson Reuters Labs, the company’s global research and development division, develops AI products that bring emerging technologies and frontier science into professional workflows. Its Thomson model family is built from leading open-weight models trained on Thomson Reuters’ authoritative content, with subject-matter-expert input. Mariner is Thomson Reuters’ custom inference platform and serves production calls to the Thomson model family. The Director, Model Inference Engineering will lead and grow the team responsible for the platform, partnering with senior technical leadership, researchers, and product stakeholders. The role ensures Mariner remains production-ready and scales with new model releases, product integrations, and international expansion, while managing cost, latency, reliability, compliance, and capacity.

Requirements

  • Experience leading or managing production inference infrastructure for large models at real production traffic and scale, with demonstrable results delivered by teams led.
  • Ability to hire, coach, and advocate for production ML-serving work.
  • End-to-end ownership of a cost-attribution or compliance program, including control design, evidence collection, and an external audit such as ISO 27001, SOC 2, or comparable.
  • Experience with a production system on Kubernetes or a similar platform.
  • Track record building and leading a focused engineering team; experience growing a team from a small group is preferred within this requirement.
  • Experience actively managing resource constraints such as GPU capacity, region availability, and cost.
  • Experience supporting external-facing or customer-facing deployments.
  • Operational excellence in engineering teams and systems.

Nice To Haves

  • Experience with LLM-serving stacks such as vLLM, TensorRT-LLM, Triton, or SGLang, or similar.
  • Experience working with research and product stakeholders to define a production system’s engineering roadmap.
  • Exposure to GPU-cluster capacity planning or multi-region or multi-cloud deployment.
  • Familiarity with systems development languages such as Rust or Go.
  • Exposure to a regulated or compliance-heavy production environment.

Responsibilities

  • Grow and lead the inference-engineering team, including setting hiring standards, conducting performance and growth conversations, supporting retention, and establishing sustainable operating practices for on-call, incident reviews, and onboarding.
  • Own delivery of Mariner’s engineering roadmap by planning and resourcing work with technical leadership, engineers, and researchers against objectives and key results.
  • Drive product integrations and international deployment while balancing cost and latency targets.
  • Scale the production platform by driving the ISO 27001 compliance path, delivering cost tracking and attribution for Finance, and planning for GPU capacity contingencies.
  • Represent inference-engineering tradeoffs involving cost, latency, and reliability to senior leadership and cross-functional partners.
  • Ensure token-economics benchmarks are produced and published to demonstrate Thomson’s cost advantage over closed-model APIs when supported by the results.

Benefits

  • Flexible hybrid work environment for office-based roles.
  • Work-from-anywhere flexibility for up to 8 weeks per year.
  • Flexible vacation and paid time off, including sick and safe leave and paid holidays.
  • Two company-wide Mental Health Days off and access to the Headspace app.
  • Health, dental, vision, disability, and life insurance.
  • 401(k) plan with company match.
  • Tuition reimbursement.
  • Employee incentive programs and an employee stock purchase plan.
  • Parental leave and sabbatical leave.
  • Flexible Spending and Health Savings Accounts.
  • Fitness reimbursement and access to an Employee Assistance Program.
  • Commuter benefits.
  • Adoption and surrogacy assistance.
  • Two paid volunteer days annually and opportunities for pro-bono consulting and ESG initiatives.
  • Resources for mental, physical, and financial wellbeing.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service