AI Hardware Optimization Engineer Intern

NeuroSpark • Santa Clara, CA

3h

About The Position

As an AI Hardware Optimization Intern at NeuroSpark, you will work on performance problems at the boundary between machine learning software and modern accelerator hardware. This internship is designed for students interested in GPU programming, computer architecture, compilers, parallel computing, or performance engineering. Prior industry experience is not required.

You will benchmark and profile ML operators and model workloads on accelerators, help develop and test kernel-level and runtime-level optimizations, and build performance benchmarks and profiling tools. You will experiment with techniques such as tiling, operator fusion, memory reuse, and parallel execution, compare strategies across hardware platforms, and work directly with engineers on production-relevant AI workloads.

Requirements

• Currently pursuing a Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
• Programming experience in C/C++.
• Familiarity with Python.
• Coursework or project experience in systems, computer architecture, operating systems, parallel computing, or compilers.
• Interest in understanding how software performance maps to hardware behavior.

Nice To Haves

• CUDA or other GPU programming experience.
• Projects involving kernels, compilers, HPC, or ML systems.
• Familiarity with PyTorch, JAX, TensorFlow, or Triton.
• Experience using performance profilers.
• Understanding of GPU memory hierarchy and parallel programming concepts.

Responsibilities

• Benchmark ML operators and model workloads on accelerators.
• Profile kernel execution, memory access, and hardware utilization.
• Help develop and test kernel-level and runtime-level optimizations.
• Experiment with tiling, operator fusion, memory reuse, and parallel execution.
• Build performance benchmarks and profiling tools.
• Compare optimization strategies across different hardware platforms.
• Work directly with engineers on production-relevant AI workloads.

What This Job Offers

• Job Type: Full-time
• Career Level: Intern