Senior Software Development Engineer, AWS Neuron Frameworks

Amazon • Cupertino, CA

229d

About The Position

AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators. As a part of the Neuron Frameworks team you'll develop and enhance support PyTorch and JAX for AWS Neuron, working with the open source ecosystem. You will develop and extend support for the leading ML frameworks, delivering an outstanding user experience for PyTorch and JAX ML model development on the Trainium and Inferentia accelerators. You will work closely with teams across AWS Neuron including compiler, training and inference optimization to optimize frameworks for AWS's accelerator architectures, and engage closely with the PyTorch and JAX and other ML Framework communities to take advantage of their latest capabilities and improve performance and usability for ML model developers.

Requirements

• Experience developing Machine Learning infrastructure and/or ML Frameworks.
• Demonstrated ability to work with open source communities.
• Robust technical ability and motivation to achieve results.
• Experience with technologies and tools such as XLA, vLLM or Hugging Face transformers.

Responsibilities

• Develop, improve and release JAX and PyTorch framework support for AWS Neuron.
• Understand current and future directions of ML framework development.
• Set the direction for the AWS Neuron framework technology roadmap.
• Shape the future of framework support on accelerators.
• Enable key features for AWS Neuron such as torch.compile().
• Work closely with the PyTorch and JAX community to drive future directions.

Benefits

• Work-life harmony.
• Flexible working culture.
• Diverse experiences valued.
• Mentorship and career growth opportunities.

What This Job Offers

• Career Level: Mid Level