AI Inference Center Product Manager

Gruve • Redwood City, CA

11d

About The Position

As an AI Inference Center Product Manager , you will play a pivotal role in defining and delivering next-generation full-stack (hardware + software) datacenter solutions that combine innovative GPU platforms, high-speed networking, scalable storage, and advanced cooling technologies. You will help shape the future of AI infrastructure—supporting AI inference pipeline—by aligning customer needs with Gruve’s engineering innovation and operational capabilities. This role requires deep knowledge of the AI cloud software ecosystem—both public and on-premise—as well as the hardware that powers it. Success demands a blend of product leadership, market research, project coordination, and executive-level communication. You will lead through influence to develop and drive to market tightly integrated solutions built on platforms such as NVIDIA HGX, AMD Instinct, NVMe-over-Fabrics, DLC/air cooling, and AI-aware telemetry and monitoring systems.

Requirements

• Bachelor’s degree in Computer Science or Computer/Electrical Engineering
• 5 + years of experience in product management, solutions architecture, or technical marketing
• Strong background in datacenter infrastructure (servers, networking, storage), AI platforms, or cloud-native environments
• Demonstrated experience driving complex projects in cross-functional, matrixed organizations
• Excellent presentation skills, with proficiency in PowerPoint and storytelling for executive and technical audiences
• Ability to perform market research, competitive analysis, and customer engagement activities
• High-level understanding of product lifecycle—from concept to launch

Nice To Haves

• Experience with Supermicro hardware, A M D-based/NVIDIA-based/RTX-based AI infrastructure, Kubernetes, or cloud orchestration
• Familiarity with Agile methodologies and product management tools (e.g., Jira, Aha! , Microsoft Project )
• Prior experience in enterprise IT, datacenter design, or cloud infrastructure product development , network management
• MBA or advanced degree in technical or business field

Responsibilities

• Product Strategy for Modern Datacenters Work with Vendors Building Blocks to define specific solutions and contribute to a DCBBS product roadmap for cutting-edge datacenter solutions that integrate GPU-accelerated computing, high-speed networking.
• Stay ahead of industry trends in AI infrastructure, liquid cooling, and next-gen data pipelines.
• Cross-Functional Project Leadership Lead the planning and execution of multi-disciplinary initiatives across hardware engineering, software teams, operations, and marketing.
• Coordinate development of tightly integrated solutions involving GPUs and AI-ready platforms.
• Monitoring, Analytics & Optimization Partner with Gruve software and BIOS/BMC teams to ensure we include monitoring and analytics capabilities, enabling predictive maintenance, performance tuning, and workload-aware optimization for AI use cases.
• AI Inference and Data Workflow Enablement Work closely with AI/ML customers to identify the latest trends in infrastructure requirements for AI inference, and data processing workloads.
• Understand the myriad of products and features that can optimize large language models, data lakes, and AI pipelines.

Benefits

• At Gruve, we foster a culture of innovation, collaboration, and continuous learning. We are committed to building a diverse and inclusive workplace where everyone can thrive and contribute their best work.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level