Compiler Engineer II - Machine Learning, Annapurna Labs

Amazon • Cupertino, CA

1d • $143,700 - $223,600 • Onsite

About The Position

Annapurna Labs, a key part of AWS innovation, is responsible for silicon development. This role focuses on AWS Machine Learning accelerators, specifically the Inferentia and Trainium chips, which are crucial for Generative AI on AWS. The AWS Neuron Software Development Kit (SDK), including an ML compiler and runtime, integrates with popular ML frameworks like PyTorch, TensorFlow, and JAX, and is used extensively by customers. The Neuron Compiler team is developing a deep learning compiler stack to optimize LLM and Vision models for AWS accelerators, aiming for significant performance improvements. As a Compiler Engineer II, you will contribute to the development and scaling of this compiler for large ML workloads, architecting and implementing features, publishing research, and collaborating with AWS ML services teams. You will be involved in pre-silicon design and bringing new products to market.

Requirements

• Bachelor's degree or equivalent
• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Proficiency with 1 or more of the following programming languages: C++ (preferred), C, Python

Nice To Haves

• A background in compiler development is strongly preferred.
• A background in Machine Learning and AI accelerators is preferred, but not required.
• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• 2+ years of working with Advanced Compute technologies including, but not limited to: Accelerated Compute, High Performance Compute, Visual/Spatial Compute, and/or IoT. experience
• Masters or PhD degree in computer science or equivalent
• Experience optimizing Tensorflow, PyTorch or JAX deep learning models
• Experience with multiple toolchains like LLVM, XLA/OpenXLA, MLIR

Responsibilities

• Solve challenging technical problems at every layer of the stack.
• Design, implement, test, deploy and maintain innovative software solutions to transform service performance, durability, cost, and security.
• Build high-quality, highly available, always-on products.
• Research implementations that deliver the best possible experiences for customers.
• Design and code solutions to drive efficiencies in software architecture.
• Create metrics, implement automation and other improvements.
• Resolve the root cause of software defects.
• Build high-impact solutions to deliver to our large customer base.
• Participate in design discussions, code review, and communicate with internal and external stakeholders.
• Work cross-functionally to help drive business decisions with your technical input.
• Work in a startup-like development environment.

Benefits

• health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• paid time off
• parental leave
• sign-on payments
• restricted stock units (RSUs)

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level