Staff Software Engineer - AI/ML Platform

Fanatics Commerce • Redwood City, CA

2d • $190,000 - $237,500

About The Position

Fanatics Commerce is seeking a Staff Software Engineer for its AI/ML Platform pod. This role is responsible for building and owning the internal AI platform, which supports teams working with LLMs, MCPs, and agents. The platform includes components for gateway, agent runtime, registry, retrieval, evaluation, and cost analytics, all running on a petabyte-scale lakehouse with enterprise-grade governance. This is a hands-on, Staff-level position where the engineer will define architecture, set standards, and contribute significantly to coding, particularly on the most challenging parts of the platform. The decisions made in this role will have long-term organizational impact.

Requirements

• 8 to 12 years building production software, including 2+ years on AI/ML platform.
• Bachelor's or Master's in Computer Science, Engineering, or a related field.
• Staff-level impact: system design across multiple services, decisions that span teams, and platforms other engineers build on.
• Strong Python and FastAPI, plus one of Java, GoLang, Scala, or TypeScript.
• Hands-on with Terraform, Kubernetes, Airflow, Postgres, Grafana, and Prometheus.
• Familiar enough with the AWS data science toolkit and libraries like PyTorch to partner credibly with data scientists.
• Hands-on with LLMs and generative AI on Bedrock or Vertex: model routing, RAG, tool calling, structured outputs, and context engineering.
• Agentic systems and MCP server and client integrations.
• Agent runtimes such as AWS Bedrock AgentCore.
• Exposure to self-hosted serving with vLLM, SGLang, or llama.cpp.
• The data engineering behind retrieval: chunking, embedding, and indexing pipelines, vector or search backends such as OpenSearch, open lakehouse table formats, and a working method for measuring retrieval quality.
• LLM evaluation and observability: eval dataset design, tracing, LLM-as-judge scoring, and regression testing, with tools such as Langfuse or Arize Phoenix.
• Security and governance for AI platforms: RBAC, OAuth2/OIDC, least privilege, cost optimization, and usage metering.
• Writes clearly and holds the room with executives.

Nice To Haves

• Chat UI or internal developer portal work is welcome.
• Familiarity with governance systems like DataHub and semantic layers.
• Familiarity with administering enterprise AI tools such as ChatGPT Enterprise, Claude Enterprise, or Glean.
• Open-source contributions or published work in agentic AI or LLMOps is welcome.

Responsibilities

• Own the end-to-end architecture of the AI control plane: gateway, agent runtime, registry, retrieval, evaluation, and cost. Set technical direction, sequence the roadmap, and make the build-versus-buy calls.
• Build the enterprise LLM gateway: multi-provider routing, failover, caching, rate limiting, token optimization, and key management, with a path to self-hosted open-weight models where cost, latency, or data residency call for it.
• Build the Agent/MCP ecosystem on a managed runtime such as AWS Bedrock AgentCore: enterprise systems exposed as governed tools over MCP, a control-plane registry for discovery, ownership, versioning, and lifecycle, and a no-code path from prototype to governed production agent, surfaced through a company-wide chat portal.
• Own the unified retrieval layer and the data platform behind it: the governed front door plus the ingestion, chunking, embedding, and indexing pipelines and the vector and search backends that feed it, kept reproducible, observable, and quality-gated at petabyte scale.
• Build the evaluation and feedback loop: offline evals, tracing, and regression gates in CI/CD, with production failures and user edits turning into new eval cases and root-cause attribution across prompts, retrieval, tools, and models.
• Own governance and cost: RBAC, agent identity, least-privilege access to enterprise data, audit logging, use-case-level cost attribution, and the enterprise AI tool portfolio, standing up to finance, executive, and EU AI Act scrutiny.
• Raise the bar: set the engineering standards, mentor engineers, and represent the architecture and its trade-offs directly to senior leadership.

Benefits

• The salary range represents base pay only and does not include short-term or long-term incentive compensation.
• For information about our benefits, please visit https://benefitsatfanatics.com/

What This Job Offers

• Job Type: Full-time
• Career Level: Senior