AI Inference & Training Framework Engineer Intern

NeuroSpark • Santa Clara, CA

4h

About The Position

As an AI Inference & Training Framework Intern at NeuroSpark, you will work on systems that run, scale, and optimize modern AI models. Projects may involve model serving, distributed training, scheduling, caching, communication, framework integration, or runtime performance. This internship is a strong fit for students interested in ML systems, distributed systems, or AI infrastructure. Prior full-time industry experience is not required.

Requirements

• Currently pursuing a Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, or a related field.
• Strong programming ability in Python, C++, or both.
• Coursework or project experience in distributed systems, operating systems, machine learning systems, networking, or parallel computing.
• Familiarity with at least one modern ML framework.
• Comfortable developing in a Linux environment.
• Strong interest in understanding how large-scale AI systems work under the hood.

Nice To Haves

• PyTorch, JAX, TensorFlow, vLLM, or SGLang experience.
• Experience running models across multiple GPUs.
• CUDA or GPU programming exposure.
• Familiarity with distributed training or inference.
• Experience with Docker, Kubernetes, cloud infrastructure, or networking.
• Research, personal projects, or open-source contributions related to ML systems.

Responsibilities

• Develop and benchmark inference or training framework components.
• Run and integrate models using PyTorch, JAX, vLLM, or related frameworks.
• Analyze latency, throughput, memory usage, and distributed performance.
• Experiment with batching, caching, scheduling, and parallel execution.
• Build multi-GPU inference or training prototypes.
• Develop testing, profiling, and developer tooling.
• Debug performance and correctness issues in real AI workloads.
• Work directly with engineers on production-relevant infrastructure problems.

What This Job Offers

• Job Type: Full-time
• Career Level: Intern
• Education Level: No Education Listed