The Architecture Research Lab is researching AI system architectures to address memory bandwidth and communication bottlenecks. This internship focuses on how memory systems should evolve for agentic AI, whose long-horizon, multi-turn workloads accumulate context faster than memory capacity and bandwidth grow. The intern will research memory architectures and system optimizations to maintain accurate, efficient inference; evaluate them using performance models and accuracy studies; and translate research findings into publications and requirements for future memory products. The work spans AI system architecture up to the rack level, including memory hierarchies that combine HBM, near-memory compute, High Bandwidth Flash, and host or CXL memory. The intern will characterize LLM and agentic workloads, study placement and movement of model weights and KV cache, develop performance models and simulators, explore architectural tradeoffs, and assess accuracy impacts using open models and relevant benchmarks. The role collaborates with architects, memory technologists, and system-software researchers, and contributes to publications, invention disclosures, and future product directions. The position requires daily onsite presence at Samsung’s San Jose headquarters and reports to a Principal Engineer.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Intern
Education Level
Ph.D. or professional degree