Amazon.com-posted 11 months ago
$129,300 - $223,600/Yr
Full-time • Mid Level
Hybrid • Seattle, WA
5,001-10,000 employees
General Merchandise Retailers

AWS Utility Computing (UC) provides product innovations that continue to set AWS's services and features apart in the industry. As a member of the UC organization, you'll support the development and management of Compute, Database, Storage, Platform, and Productivity Apps services in AWS, including support for customers who require specialized security solutions for their cloud services. Additionally, this role may involve exposure to and experience with Amazon's growing suite of generative AI services and other cutting-edge cloud computing offerings across the AWS portfolio. Annapurna Labs (our organization within AWS UC) designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions that solve challenges that were unimaginable a short time ago-even yesterday. Our custom chips, accelerators, and software stacks enable us to take on technical challenges that have never been seen before, and deliver results that help our customers change the world. AWS Neuron is the complete software stack for the AWS Inferentia (Inf1/Inf2) and Trainium (Trn1), our cloud-scale Machine Learning accelerators. This role is for a machine learning engineer in the Distribute Training team for AWS Neuron, responsible for development, enablement and performance tuning of a wide variety of ML model families, including massive-scale Large Language Models (LLM) such as GPT and Llama, as well as Stable Diffusion, Vision Transformers (ViT) and many more. The ML Distributed Training team works side by side with chip architects, compiler engineers and runtime engineers to create, build and tune distributed training solutions with Trainium instances. Experience with training these large models using Python is a must. FSDP (Fully-Sharded Data Parallel), Deepspeed and other distributed training libraries are central to this and extending all of this for the Neuron based system is key.

  • Help lead the efforts building distributed training support into Pytorch, Tensorflow using XLA and the Neuron compiler and runtime stacks.
  • Tune models to ensure highest performance and maximize efficiency on custom AWS Trainium and Inferentia silicon and the Trn1, Inf1/2 servers.
  • Collaborate with chip architects, compiler engineers, and runtime engineers to create, build, and tune distributed training solutions.
  • Bachelor's degree in computer science or equivalent.
  • 3+ years of non-internship professional software development experience.
  • 2+ years of non-internship design or architecture experience of new and existing systems.
  • Experience programming with at least one software programming language.
  • Experience in machine learning, data mining, information retrieval, statistics or natural language processing.
  • Master's degree in computer science or equivalent.
  • 3+ years of full software development life cycle experience.
  • Experience in computer architecture.
  • Previous software engineering expertise with Pytorch/Jax/Tensorflow, Distributed libraries and Frameworks, End-to-end Model Training.
  • Previous experience with training multi-modal models for understanding and generating images/videos/audios.
  • Flexible working culture.
  • Mentorship and career growth opportunities.
  • Diverse and inclusive workplace.
  • Work-life harmony.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service