Software Engineer - AI/ML, AWS Neuron Distributed Training

Amazon.com • Seattle, WA

382d • $129,300 - $223,600 • Hybrid

About The Position

AWS Utility Computing (UC) provides product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the development and management of Compute, Database, Storage, Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for their cloud services. Additionally, this role may involve exposure to and experience with Amazon's growing suite of generative AI services and other cutting-edge cloud computing offerings across the AWS portfolio. Annapurna Labs (our organization within AWS UC) designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions that solve challenges that were unimaginable a short time ago-even yesterday. Our custom chips, accelerators, and software stacks enable us to take on technical challenges that have never been seen before, and deliver results that help our customers change the world. AWS Neuron is the complete software stack for the AWS Inferentia (Inf1/Inf2) and Trainium (Trn1), our cloud-scale Machine Learning accelerators. This role is for a machine learning engineer in the Distribute Training team for AWS Neuron, responsible for development, enablement and performance tuning of a wide variety of ML model families, including massive-scale Large Language Models (LLM) such as GPT and Llama, as well as Stable Diffusion, Vision Transformers (ViT) and many more. The ML Distributed Training team works side by side with chip architects, compiler engineers and runtime engineers to create, build and tune distributed training solutions with Trainium instances. Experience with training these large models using Python is a must. FSDP (Fully-Sharded Data Parallel), Deepspeed and other distributed training libraries are central to this and extending all of this for the Neuron based system is key.

Requirements

• Bachelor's degree in computer science or equivalent.
• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship design or architecture experience of new and existing systems.
• Experience programming with at least one software programming language.
• Experience in machine learning, data mining, information retrieval, statistics or natural language processing.

Nice To Haves

• Master's degree in computer science or equivalent.
• 3+ years of full software development life cycle experience.
• Experience in computer architecture.
• Previous software engineering expertise with Pytorch/Jax/Tensorflow, Distributed libraries and Frameworks, End-to-end Model Training.
• Previous experience with training multi-modal models for understanding and generating images/videos/audios.

Responsibilities

• Help lead the efforts building distributed training support into Pytorch, Tensorflow using XLA and the Neuron compiler and runtime stacks.
• Tune models to ensure highest performance and maximize efficiency on custom AWS Trainium and Inferentia silicon and the Trn1, Inf1/2 servers.
• Collaborate with chip architects, compiler engineers, and runtime engineers to create, build, and tune distributed training solutions.

Benefits

• Flexible working culture.
• Mentorship and career growth opportunities.
• Diverse and inclusive workplace.
• Work-life harmony.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: General Merchandise Retailers
• Education Level: Bachelor's degree
• Number of Employees: 5,001-10,000 employees