AI Engineer

Wellington Management•Boston, MA
•$90,000 - $180,000•Hybrid

About The Position

The Lead AI Engineer, Enterprise AI Platform, will design, build, and operationalize the shared enterprise platform used to develop, deploy, and operate production AI applications and agents safely at scale. This is a senior, hands-on role spanning software and platform engineering, agentic AI development, cloud infrastructure, security, and developer experience. The role turns enterprise architecture into reusable services, APIs, SDKs, infrastructure automation, and engineering standards. The platform is anchored on Microsoft Azure and Microsoft Foundry, including Foundry Agent Service and hosted agents, while operating in a pragmatic multi-cloud and multi-model environment. The focus is on durable engineering capabilities rather than dependence on any single product, making the governed path the fastest path for product and engineering teams. The engineer owns significant platform capabilities from architecture through production operation, establishes standards and reference architectures, leads complex cross-functional initiatives, mentors engineers, and communicates trade-offs, risks, sequencing, and investment needs. The role is based in Boston, Massachusetts, with a hybrid schedule: employees work from the office four days per week and may work remotely one day per week.

Requirements

  • At least 8 years of professional software, cloud, or platform engineering experience.
  • At least 3 years of experience building production machine learning or advanced data platforms.
  • At least 1 year of experience delivering production LLM or agent-based systems.
  • Demonstrated technical leadership for significant production systems.
  • Strong hands-on software engineering skills in Python and at least one additional language, such as TypeScript, Java, C#, or Go.
  • Deep experience with several of the following: LLM APIs, agentic architecture, tool or function calling, retrieval-augmented generation, embeddings, vector retrieval, context engineering, orchestration, model routing, observability, and MCP.
  • Hands-on experience designing and operating agent evaluations, including test datasets, automated and LLM-as-judge scoring, tool-use and trajectory assessment, safety and groundedness checks, and regression gating within CI/CD.
  • Strong cloud platform engineering experience, with depth in Microsoft Azure technologies such as Microsoft Foundry, Foundry Agent Service, model deployments, Azure AI services, API Management, Entra ID, private networking, Key Vault, Application Insights, Azure Monitor, Infrastructure as Code, and CI/CD.
  • Experience building platform capabilities used by other engineering teams, including APIs, SDKs, self-service infrastructure, developer tooling, runtime controls, telemetry, and production support.
  • Strong understanding of distributed systems, API design, reliability, security, identity, networking, and operational risk.
  • Demonstrated ability to create durable platform capabilities that enable multiple product and engineering teams to succeed.

Nice To Haves

  • Experience with agent orchestration frameworks such as Microsoft Agent Framework or LangGraph.
  • Familiarity with agent-to-agent interoperability and related standards.
  • Experience developing MCP servers and implementing OAuth, on-behalf-of identity, and token-exchange patterns.
  • Experience implementing Azure API Management or another AI gateway.
  • Experience with OpenTelemetry, Kubernetes or AKS, Bicep or Terraform, and GitHub Actions or Azure DevOps.
  • Familiarity with Microsoft Purview, Microsoft Fabric, Azure AI Search, and enterprise data-security controls.
  • Experience with advanced evaluation practices, including adversarial testing, red-team testing, online evaluation, model comparison, agent traceability, quota management, and AI FinOps.
  • Experience with AWS and hybrid or multi-cloud architecture.
  • Experience in financial services or another highly regulated environment.

Responsibilities

  • Design and implement shared enterprise AI platform capabilities, including model access, agent runtimes, orchestration, gateways, MCP and tool integration, retrieval services, registries, observability, evaluations, guardrails, and FinOps controls.
  • Build reusable platform capabilities and self-service workflows that help application and business teams deliver secure, observable, and resilient production solutions.
  • Establish patterns, frameworks, and reference implementations for single-agent and multi-agent applications.
  • Develop standards for agent interoperability, prompts, context, state, memory, human approvals, kill switches, retries, fallback, versioning, service-level objectives, and controlled production promotion.
  • Create a governed, model-agnostic access layer with authentication, identity propagation, routing, quotas, rate limits, failover, usage attribution, policy enforcement, and provider abstraction.
  • Support model access across Azure, AWS, and approved on-premises services, including Azure API Management patterns in front of Foundry model deployments.
  • Build secure MCP servers and gateways, and define patterns for hosting, OAuth, delegated authorization, on-behalf-of identity, token exchange, tool discovery, registration, and allowlisting.
  • Partner with Identity, Cybersecurity, and Cloud Engineering teams to implement enterprise identity controls.
  • Develop workload and per-agent identity with lifecycle management and Conditional Access using Microsoft Entra ID and Entra Agent ID.
  • Implement role-based access control, least privilege, app-registration automation, secrets elimination, cross-cloud federation, and entitlement-aware data access.
  • Design and operate agent evaluation frameworks and regression pipelines measuring task success, tool-use correctness, groundedness, safety, and use-case-specific outcomes; use evaluations as automated quality gates for production promotion.
  • Instrument agent runs, LLM requests, retrieval, tool calls, latency, errors, quality, policy events, token usage, and cost using OpenTelemetry-based standards where possible.
  • Implement guardrails, content-safety controls, prompt-injection defenses, data-loss protections, red-team testing, audit trails, and agent and model inventories.
  • Align platform capabilities with applicable regulatory and model-risk requirements, including the NIST AI Risk Management Framework, SR 11-7, and the EU AI Act where relevant.
  • Treat the platform as a product through Infrastructure as Code, CI/CD, automated promotion, policy as code, SDKs, templates, reference implementations, documentation, and self-service onboarding.
  • Make pragmatic build-versus-buy decisions and evaluate changing AI technologies without chasing every new framework.
  • Establish engineering standards, reference architectures, code-review practices, and production-readiness criteria.
  • Lead technically complex initiatives across AI, Cloud, Security, Data, Architecture, and product engineering teams.
  • Mentor AI and platform engineers while reducing dependence on individual specialists or external resources.
  • Communicate trade-offs, risks, sequencing, and investment needs clearly to engineers and senior leaders.

Benefits

  • Salary, variable compensation, and benefits; a discretionary Corporate Bonus and/or incentives may also be available if eligible.
  • Retirement plan.
  • Health and wellbeing coverage, including health, dental, vision, and pharmacy coverage.
  • Health savings account and flexible spending accounts.
  • Commuter program.
  • Employee assistance program.
  • Life and disability insurance.
  • Adoption assistance.
  • Back-up childcare.
  • Tuition/CFA reimbursement.
  • Paid time off, including leave of absence, paid holidays, volunteer, sick, and vacation time.
  • Flexible work environment, with one day per week available for remote work.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service