Senior AI Platform Engineer, Atlas AI

Cognite•Houston, TX

About The Position

Cognite operates at the forefront of industrial digitalization, building AI and data solutions that solve some of the world’s hardest, highest-impact problems. With unmatched industrial heritage and a comprehensive suite of AI capabilities, including low-code AI agents, Cognite accelerates the digital transformation to drive operational improvements. Our moonshot is bold: unlock $100B in customer value by 2035 and redefine how global industry works. What Cognite is Relentless to achieve We thrive in challenges. We challenge assumptions. We execute with speed and ownership. If you view obstacles as signals to step forward - not step back - you’ll feel at home here. Join us in this venture where AI and data meet ingenuity, and together, we forge the path to a smarter, more connected industrial future. How you’ll demonstrate Ownership We are seeking an AI Platform Engineer to join the Cognite Atlas AI Product team in Phoenix, AZ, to engineer, build, and operate the production-grade, multi-cloud platform that enables our internal and partner teams to build, deploy, and manage industrial AI agents. You will be responsible for creating the core services, frameworks, and infrastructure for our "agent builder workbench" and agent runtime, focusing on scalability, reliability, cost-efficiency, and security. Your work will directly impact industrial efficiency and sustainability, which is critical to our mission of powering a high-tech, sustainable, and profitable industrial future. The Impact you bring to Cognite Design, build, and maintain the core Python SDKs and services for the Atlas AI platform. Create clean abstractions that empower Solution Engineers to easily define and test agents and workflows. Build the core agentic runtime, ensuring it is scalable, meets its SLOs, and can reliably manage the state, orchestration, and execution of industrial agents. Develop a robust, governed, and secure framework for AI agent tool-use. Engineer the platform components that allow solution engineers to safely add new tools (e.g., API calls, database queries) and that manage the secure execution, monitoring, and access control for those tools. Manage the LLM serving layer, including deploying and optimizing models for low-latency/high-throughput inference. Build and maintain model routing logic to select the most appropriate model (e.g., performance vs. cost) for a given task. Implement evaluation and observability for all AI services. Create standardized frameworks for systematically evaluating the performance, accuracy, cost, and safety of LLMs and agentic workflows. Drive the implementation of robust, automated testing strategies for LLM-based systems. Own the full development lifecycle for services in a production SaaS environment. This includes establishing automated code coverage goals, rigorous code reviews, defining SLOs, participating in on-call rotations, and ensuring a fast and effective incident response process. Work closely with the Lead Architect to translate the technical vision into implemented, production-grade services. Act as a key partner for the Solution Engineers (your internal customers) to understand their needs and abstract common patterns into reusable, robust platform components. Stay up to date on the latest developments in the field, and mentor junior developers.

Requirements

Bachelor's or Master’s degree in Computer Science or a related field, or equivalent practical experience.
8+ years of professional experience in backend software engineering, platform engineering, or MLOps, with a proven track record of architecting and operating complex systems at scale.
2+ years of hands-on experience building applications or platforms on top of AI/ML models or LLMs.
Expert-level proficiency in Python and a strong background in software architecture, robust API design, and building maintainable, well-documented SDKs for other developers.
Hands-on experience with Kubernetes (K8s) and building services on managed PaaS in a multi-cloud environment (AWS, Azure, GCP).
Strong understanding of Infrastructure as Code (e.g., Terraform).
Proven experience building and operating production-grade SaaS software.
Understanding of the full development life cycle, including CI/CD, monitoring, telemetry, and on-call incident response.
Practical experience with LLM orchestration frameworks (Bedrock, Vertex, Semantic Kernel, LangChain).
Strong verbal and written communication skills, with the ability to articulate complex technical designs and decisions clearly.

Nice To Haves

Hands-on experience deploying and managing LLMs in production using high-performance serving frameworks.
Experience with MLOps/LLMOps tools for tracing, monitoring, and evaluating LLM applications (LangSmith, Arize, Phoenix, or equivalent).
Experience with RAG Infrastructure, embedding generation pipelines, vector database integrations, and high-performance vector similarity search APIs.

Responsibilities

Design, build, and maintain the core Python SDKs and services for the Atlas AI platform.
Create clean abstractions that empower Solution Engineers to easily define and test agents and workflows.
Build the core agentic runtime, ensuring it is scalable, meets its SLOs, and can reliably manage the state, orchestration, and execution of industrial agents.
Develop a robust, governed, and secure framework for AI agent tool-use.
Engineer the platform components that allow solution engineers to safely add new tools (e.g., API calls, database queries) and that manage the secure execution, monitoring, and access control for those tools.
Manage the LLM serving layer, including deploying and optimizing models for low-latency/high-throughput inference.
Build and maintain model routing logic to select the most appropriate model (e.g., performance vs. cost) for a given task.
Implement evaluation and observability for all AI services.
Create standardized frameworks for systematically evaluating the performance, accuracy, cost, and safety of LLMs and agentic workflows.
Drive the implementation of robust, automated testing strategies for LLM-based systems.
Own the full development lifecycle for services in a production SaaS environment. This includes establishing automated code coverage goals, rigorous code reviews, defining SLOs, participating in on-call rotations, and ensuring a fast and effective incident response process.
Work closely with the Lead Architect to translate the technical vision into implemented, production-grade services.
Act as a key partner for the Solution Engineers (your internal customers) to understand their needs and abstract common patterns into reusable, robust platform components.
Stay up to date on the latest developments in the field, and mentor junior developers.

Benefits

Competitive compensation
401(k) with employer matching
Competitive health, dental, vision & disability coverages for employees and all dependents
Unlimited PTO
Paid Parental Leave Program
Employee Referral Program
Join a team of 60+ different nationalities 🌐 with Diversity, Equality and Inclusion (DEI) in focus 🤝.
A highly modern and fun working environment with sublime culture across the organization, follow us on Instagram @ cognitedata 📷 to know more
Opportunity to work with and learn from some of the best people on some of the most ambitious projects found anywhere, across industries
Join our HUB 🗣️ to be part of the conversation directly with Cogniters and our partners.
Paid mobile phone and WiFI