Senior AI Platform Architect

Moring Ai•Alpharetta, GA

21h•$160,000 - $180,000•Onsite

About The Position

Moring.ai is hiring a hands-on Senior AI Platform Architect to own the end-to-end architecture of an AI platform for a large financial services enterprise. The platform enables the customer's developers to build and deploy agentic AI workflows—Python applications that call LLMs, use tools, and run as agents on Kubernetes. Its capabilities include an LLM gateway, agent runtime, MCP servers for tools and data, a skills registry, retrieval, evaluation, observability, and identity and governance controls. The architect will make platform design decisions and produce design documents, code reviews, and reference implementations. The role includes designing the AWS and Kubernetes foundations, agent identity and developer experience, and reusable, governed patterns for MCP servers, skills, tools, and prompts. The architect will present and defend designs to customer architects, platform teams, security teams, and model risk reviewers, while mentoring senior engineers and evaluating emerging AI platform capabilities. The position is based 100% onsite in Alpharetta, Georgia, with up to 10% travel to customer sites. The role is full-time. Compensation is $160,000–$180,000, plus a $25,000 bonus and stock options, based on experience and role match. Candidates must be authorized to work in the United States (GC/EAD/US Citizen).

Requirements

10–12 years of software engineering experience, with substantial experience building cloud, developer, container, or internal platforms, or working as a software architect with deep platform knowledge.
Very strong Kubernetes experience, including designing and operating production workloads and understanding networking, scheduling, security, multi-tenancy, and operators.
Very good AWS experience, including EKS, IAM, VPC networking, private endpoints, and Terraform or CDK; prior experience building and operating a cloud platform.
Solid understanding of AI platform concepts, including LLM gateways, agent runtimes, MCP, RAG and retrieval, skills and tool registries, evaluations, and AI observability, and the ability to explain their relationships and risks.
Strong distributed systems, API design, and security fundamentals.
Comfort with Python sufficient to build reference implementations and review code.
Ability to write clear design documents and defend trade-offs before a client's chief architect.
Authorization to work in the United States (GC/EAD/US Citizen).

Nice To Haves

Experience working in large enterprises, preferably in financial services, insurance, or healthcare.
Experience with Bedrock AgentCore or a comparable agent runtime.

Responsibilities

Own the end-to-end architecture of the AI platform, including its gateway, agent runtime, MCP layer, skills and asset registry, retrieval, evaluations, observability, identity, and governance.
Design how agents run on Kubernetes, including packaging, scheduling, scaling, isolation, networking, state and memory, versioning, promotion, and rollback.
Design the AWS foundation, including EKS, IAM, networking, private endpoints, and infrastructure-as-code for a regulated enterprise with restricted egress.
Define the identity model for agents, including agent authentication, acting on behalf of users without exceeding their access, and maintaining an audit trail.
Define the developer experience for building and deploying agents with appropriate guardrails and minimal friction.
Establish reusable, versioned, and governed patterns for MCP servers, skills, tools, and prompts.
Write architecture documents and reference implementations, and review the team's designs and code against them.
Present the architecture to customer architects, platform teams, security reviewers, and model risk reviewers, and incorporate their constraints into the design.
Evaluate AI platform capabilities such as model providers, agent frameworks, runtimes, and registries, and decide what belongs in the platform.
Mentor senior engineers and improve the team's platform engineering practices.