AI Platform Engineer

Bright Vision Technologies • Morrisville, NC

3d • $100,000 - $150,000 • Remote

About The Position

We are seeking an AI Platform Engineer to design, build, and operate scalable AI inference platforms for production ML workloads. The ideal candidate will have expertise in distributed systems, LLM serving, GPU optimization, autoscaling, and cloud-native infrastructure, with a strong focus on performance, reliability, and observability.

Requirements

• 6+ years of experience in distributed systems, infrastructure, or ML platform engineering.
• Strong proficiency in Python and Go, Rust, or C++.
• Experience with LLM inference frameworks (vLLM, TensorRT-LLM), Kubernetes, cloud platforms, and GPU optimization.

Nice To Haves

• Experience with multi-region AI deployments and AI infrastructure.
• Familiarity with model optimization techniques such as quantization or compression.
• Open-source contributions or experience supporting large-scale AI APIs.

Responsibilities

• Design and maintain scalable AI model serving platforms.
• Optimize inference performance, GPU utilization, and request routing.
• Build autoscaling, deployment, and monitoring solutions.
• Implement caching, security, and high-availability strategies.
• Collaborate with ML teams to deploy and support production AI models.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed