AI Platform Engineer
About The Position
The AI Platform Engineer is a hands-on software engineer who designs, builds, and operates the secure, scalable, governed foundation used by teams to develop and run enterprise AI applications and agents. The engineer builds and operates production-quality platform software and reusable services supporting multiple business-facing products. Capabilities may include approved model access, AI gateways, orchestration runtimes, identity and policy enforcement, evaluation, observability, deployment automation, and cost controls. This role spans platform services, APIs, distributed systems, cloud infrastructure, DevSecOps, reliability, and generative AI. The primary hiring bar is the demonstrated ability to design, code, test, review, deploy, and support production systems. The engineer translates enterprise architecture and governance requirements into reusable platform capabilities and standardized engineering paths, enabling development teams to move quickly without recreating security, integration, monitoring, or operational controls for each solution.
Requirements
- Bachelor’s degree in Computer Science, Software Engineering, Cloud Engineering, Information Systems, Data Engineering, Artificial Intelligence, or a related technical field.
- Experience in either relevant cloud, Kubernetes, DevOps, SRE, security, data, or AI certifications.
- At least 6 years of professional software engineering experience, including hands-on development of production services, APIs, or distributed systems.
- Demonstrated experience designing, coding, testing, deploying, and operating shared production services used by multiple applications or development teams.
- Hands-on proficiency with Python and at least one additional language such as TypeScript/Node.js or Java.
Nice To Haves
- Experience applying software-engineering fundamentals, including modular design, data structures, concurrency, error handling, code review, automated testing, versioning, and maintainability.
- Experience with at least one major cloud platform and technologies such as containers, Kubernetes, serverless services, API gateways, queues, databases, caches, and secrets management.
- Hands-on experience building production agentic or LLM systems using an orchestration framework such as LangGraph, Google Agent Development Kit (ADK), Semantic Kernel, or equivalent technology.
- Experience with Git, CI/CD, infrastructure as code, automated testing, observability, security controls, and production incident response.
- Practical experience integrating LLM providers or building LLM-powered platform capabilities such as gateways, RAG services, agent runtimes, evaluations, guardrails, or monitoring.
- Experience working with enterprise security, architecture, data, identity, privacy, or governance teams.
Responsibilities
- Design, code, test, deploy, and operate shared enterprise AI platform services that are secure, scalable, resilient, observable, and easy for development teams to consume.
- Write maintainable, production-quality software for platform APIs, control-plane services, data and event-processing components, SDKs, libraries, and developer tooling.
- Make software-architecture decisions covering service boundaries, interfaces, data models, concurrency, failure handling, performance, scalability, and backward compatibility.
- Implement governed access to approved foundation models and providers through gateways, APIs, SDKs, routing, quotas, authentication, authorization, and policy controls.
- Develop platform APIs, services, libraries, command-line tools, templates, and reference implementations using languages such as Python, TypeScript, or Java.
- Integrate identity, SSO, service identities, RBAC/ABAC, secrets management, network controls, data-protection controls, and audit logging into platform services.
- Build automated unit, integration, security, performance, resilience, and platform-acceptance tests.
- Create developer documentation, onboarding flows, sample applications, runbooks, reference architectures, and reusable engineering standards.
- Evaluate emerging models, frameworks, runtimes, gateways, and AI infrastructure against enterprise requirements and concrete engineering use cases.
- Partner with product and application teams to improve developer experience while maintaining clear ownership boundaries between platform and product teams.
- Develop and review platform code, infrastructure-as-code, APIs, libraries, deployment pipelines, policies, automated tests, and operational tooling.
- Work with architects, security, identity, cloud, data, and application teams to turn requirements into reusable platform capabilities.
- Act as an informal technical leader by setting platform engineering standards, reviewing designs and code, and mentoring engineers.
- May lead delivery of a shared platform capability or coordinate technical work across cloud, security, data, and application engineering teams.
Benefits
- Medical insurance
- Dental insurance
- Vision insurance
- Basic life insurance
- Paid parental leave
- Disability coverage
- 401(k) retirement plan with company matching contributions, subject to eligibility requirements
- Minimum of 15 vacation/PTO days for salaried employees
- 13 paid holidays
- Paid sick leave, adjusted based on role and location in accordance with local laws
- Salaried employees may be eligible for discretionary bonuses and profit-sharing
- Long-term incentives for Executive-level roles
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
