Software Engineer- AI/ML, AWS Neuron

Amazon • Cupertino, CA

8d

About The Position

Annapurna Labs designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions that solve challenges that were
imaginable a short time ago—even yesterday. Our custom chips, accelerators,
and software stacks enable us to take on technical challenges that have never
been seen before, and deliver results that help our customers change the world.

AWS Neuron is the complete software stack for the AWS Trainium and Inferentia
our cloud-scale Machine Learning accelerators. This role is for a Machine
Learning Engineer in the Distribute Training team for AWS Neuron, responsible
for development, enablement and performance tuning of a wide variety of ML model
families, including massive-scale Large Language Models (LLM) such as GPT and
Llama, as well as Stable Diffusion, Vision Transformers (ViT) and many more.

The ML Distributed Training team works side by side with chip architects,
compiler engineers and runtime engineers to create, build and tune distributed
training solutions with Trainium instances. Experience with training these large
models using Python is a must. FSDP (Fully-Sharded Data Parallel), Deepspeed,
Nemo and other distributed training libraries are central to this and extending
all of this for the Neuron based system is key.

Requirements

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience programming with at least one software programming language

Nice To Haves

• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent

Responsibilities

• This role will help lead the efforts building distributed training support into Pytorch and Jax using the Neuron compiler and runtime stacks.
• This role will help tune these models to ensure highest performance and maximize the efficiency of them running on the customer AWS Trainium .
• Strong software development and ML knowledge are both critical to this role.

Benefits

• Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level