AI Infrastructure Solutions Architect

MetroSys•, (Multiple States)
•$100 - $125

About The Position

MetroSys is seeking a highly experienced Senior AI Infrastructure Solutions Architect to support the design, planning, and implementation of advanced artificial intelligence computing environments for enterprise organizations. The role combines infrastructure engineering expertise with customer advisory work, translating business and technical requirements into practical, scalable architecture designs for demanding AI workloads, including large language models, machine learning, model training, and enterprise inference applications. The architect will develop enterprise-scale solutions integrating GPU compute platforms, high-throughput networking, enterprise storage, workload orchestration, and AI platform software. The position involves assessing existing data center environments, planning capacity and performance, producing architecture documentation and implementation plans, and advising customers on technology investments across on-premises, private cloud, and hybrid environments. The role also provides technical leadership in customer engagements, working with engineering, sales, delivery, security, and business stakeholders. It includes presenting architectures to technical teams and executives, evaluating competing technologies, developing reusable standards and frameworks, and mentoring infrastructure engineers and architects.

Requirements

  • 10 or more years of experience in enterprise infrastructure architecture, solutions engineering, technical consulting, or related disciplines.
  • Significant experience designing complex data center or high-performance computing environments.
  • Strong knowledge of NVIDIA GPU computing technologies and enterprise AI infrastructure.
  • Experience with accelerated computing platforms, GPU cluster architecture, and infrastructure sizing.
  • Advanced understanding of enterprise networking, including high-speed Ethernet, InfiniBand, or RoCE.
  • Experience designing enterprise storage architectures for high-throughput and performance-sensitive workloads.
  • Strong knowledge of Linux operating systems, virtualization, containerization, and Kubernetes.
  • Familiarity with AI infrastructure software, GPU orchestration, and workload scheduling technologies.
  • Experience producing high-level designs, detailed technical specifications, and infrastructure implementation documentation.
  • Demonstrated ability to lead customer-facing technical discussions and communicate complex solutions to senior stakeholders.
  • Strong understanding of infrastructure scalability, availability, performance, and security principles.
  • Ability to collaborate across compute, storage, networking, security, and application engineering teams.

Nice To Haves

  • Experience with NVIDIA DGX, HGX, MGX, or comparable accelerated computing platforms.
  • Familiarity with NVIDIA AI Enterprise, NIM, Run:ai, Mission Control, and related technologies.
  • Experience with AMD Instinct GPU platforms or other accelerator architectures.
  • Knowledge of distributed AI training, inference optimization, and large language model infrastructure requirements.
  • Experience with Red Hat OpenShift AI or other enterprise Kubernetes environments.
  • Familiarity with Slurm and GPU resource scheduling platforms.
  • Experience supporting enterprise AI infrastructure deployments in regulated environments.
  • Understanding of NIST, FedRAMP, CMMC, or comparable security frameworks.
  • Experience with GPU-dense data center infrastructure, including power and cooling considerations.
  • Python scripting or infrastructure automation experience.
  • Relevant NVIDIA, cloud architecture, Linux, Kubernetes, or enterprise infrastructure certifications.
  • Experience supporting technical pre-sales engagements, solution development, or enterprise consulting initiatives.

Responsibilities

  • Design enterprise-scale infrastructure for AI, machine learning, and high-performance computing workloads.
  • Develop architectures integrating GPU compute platforms, high-throughput networking, enterprise storage, and workload orchestration technologies.
  • Evaluate infrastructure requirements based on application performance, scalability, resource utilization, and operating costs.
  • Produce technical architecture documentation, infrastructure diagrams, hardware specifications, and implementation plans.
  • Lead infrastructure discovery sessions and technical workshops to identify customer requirements and recommend solutions.
  • Design solutions for on-premises, private cloud, and hybrid AI computing environments.
  • Assess existing data center infrastructure and recommend upgrades for GPU-intensive computing.
  • Architect solutions using NVIDIA accelerated computing technologies and alternative GPU platforms.
  • Provide technical guidance on NVIDIA DGX, HGX, MGX, and enterprise GPU computing environments; evaluate Hopper and Blackwell architectures for AI training and inference.
  • Design scalable GPU clusters and support GPU platform sizing, performance analysis, capacity planning, and optimization.
  • Evaluate AMD Instinct and Intel accelerator technologies when appropriate for customer workloads.
  • Assess rack density, power distribution, cooling, and physical data center capacity requirements.
  • Develop high-bandwidth network architectures for distributed GPU processing and AI applications.
  • Design and evaluate InfiniBand, RoCE, and high-speed Ethernet connectivity solutions.
  • Integrate high-performance storage for large-scale data processing and model training, including evaluation of NVMe-based storage, parallel file systems, and distributed storage technologies.
  • Identify network and storage bottlenecks and collaborate with engineering teams to ensure infrastructure interoperability.
  • Design platforms for containerized AI applications and distributed computing workloads using technologies such as Kubernetes, Red Hat OpenShift AI, and Linux.
  • Evaluate workload management platforms including NVIDIA Run:ai, Slurm, and other GPU scheduling technologies.
  • Provide architectural guidance on NVIDIA AI Enterprise, NVIDIA NIM, NVIDIA Mission Control, and related AI infrastructure software.
  • Support integration of MLOps platforms for model development, training, deployment, monitoring, and lifecycle management.
  • Develop infrastructure automation strategies and assist with capacity planning and performance optimization for AI workloads.
  • Incorporate enterprise security requirements into AI infrastructure architecture, including controls for workload isolation, identity and access management, and monitoring.
  • Design secure environments for sensitive datasets, proprietary models, and regulated workloads; assess security in shared-GPU and multi-tenant environments.
  • Collaborate with cybersecurity teams on organizational and regulatory requirements, logging, observability, auditability, and operational resilience.
  • Serve as a senior technical advisor during customer discovery, solution planning, and architecture engagements.
  • Translate business and technical requirements into actionable infrastructure recommendations.
  • Work with technical sales and delivery teams on solution designs, equipment requirements, implementation strategies, and project estimates.
  • Present proposed architectures to technical teams, IT leadership, and executive stakeholders.
  • Evaluate competing technologies and make recommendations based on performance, cost, and business requirements.
  • Develop reusable technical documentation, architecture standards, and solution frameworks.
  • Provide technical leadership and mentoring to infrastructure engineers and architects.
  • Maintain awareness of emerging AI infrastructure technologies and industry architecture practices.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service