Architect, AI Platform

Red River • Remote US NY, NY

1d • $142,370 - $234,770 • Remote

About The Position

We are seeking a visionary Red Hat Architect specializing in Machine Learning Operations (MLOps) and Artificial Intelligence (AI) to design, build, and scale our enterprise AI platform. In this role, you will bridge the gap between enterprise-grade infrastructure and cutting-edge artificial intelligence. You will lead the architectural design of our container-native machine learning pipelines on Red Hat OpenShift, with a heavy focus on Large Language Models (LLMs), containerized model serving, scalable runtime environments, and automated benchmarking.

Requirements

• 8-10 years in a related technology position, e.g., sales, consulting, operations, development, etc
• 5+ years of experience with Public Cloud and Linux technologies
• 3+ years of experience with Red Hat OpenShift Container Platform or Kubernetes
• 3+ years experience in production ready AI solutions.
• 3+ years experience in production ready Machine Learning use cases.

Nice To Haves

• Experience in designing and delivering implementations using various public and private cloud infrastructure technologies and providers
• Red Hat Certified Architect (RHCA) or Specialist certifications in OpenShift.
• Demonstrated experience publishing technical whitepapers, architectural blueprints, or speaking at industry conferences (e.g., Red Hat Summit, KubeCon).
• Experience in Financial Services

Responsibilities

• Design and advocate solutions that leverage the full Red Hat ecosystem to solve complex business problems, explicitly aligning AI/ML capabilities with customer strategic goals.
• Work hand-in-hand with customer associates and executive stakeholders to guide the adoption of Artificial Intelligence and MLOps processes, drastically improving model time-to-market and operational efficiency.
• Collaborate with project and customer team members to manage scope, mitigate architectural risks, and consistently meet delivery timelines and project goals.
• Participate in consulting sales motions to discover customer pain points, scope complex engineering engagements, architect high-level proposals, and deliver compelling technical demonstrations/proof-of-concepts (PoCs).
• Contribute heavily to project documentation and diagrams, capturing architectural blueprints, deployment guides, and best practices to ensure long-term customer success and internal knowledge reuse.
• Commit to continuous training and professional development to stay at the absolute forefront of the rapidly evolving LLM, MLOps, and Cloud-Native ecosystem.
• Architect and build production-grade MLOps pipelines using Red Hat OpenShift Container Platform and Red Hat OpenShift AI (RHOAI).
• Guide customers through Model Selection (e.g., Llama, Mistral, Granite) by analyzing specific business use cases against hardware/GPU memory constraints, cost profiles, and licensing models.
• Design containerized Model Deployment architectures using KServe, optimizing low-latency Inference Servers (e.g., vLLM, TGI, Triton) within OpenShift environments.
• Establish automated Benchmarking and Test pipelines to measure tokens-per-second throughput, hardware efficiency, and cost-per-inference metrics.
• Mentor and share knowledge with customers through structured workshops, paired programming sessions, and architectural reviews, empowering their internal teams to confidently manage the platform post-delivery.
• Act as an internal champion, coaching junior consultants and engineering associates on the nuances of deploying AI workloads on Kubernetes.

Benefits

• Comprehensive medical, dental, and vision coverage
• Flexible Spending Account - healthcare and dependent care
• Health Savings Account - high deductible medical plan
• Retirement 401(k) with employer match
• Paid time off and holidays
• Paid parental leave plans for all new parents
• Leave benefits including disability, paid family medical leave, and paid military leave
• Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed