ML Compiler Engineer, Annapurna Labs

Amazon • Cupertino, CA

1d • $165,200 - $223,600 • Onsite

About The Position

The AWS Neuron Compiler team is seeking skilled compiler engineers to develop a state-of-the-art deep learning compiler stack. This stack optimizes application models across diverse domains like Large Language and Vision, originating from frameworks such as PyTorch, TensorFlow, and JAX. The role involves working closely with custom-built Machine Learning accelerators, including Inferentia/Trainium, which are at the forefront of AWS innovation for advanced ML capabilities, powering solutions like Generative AI. As an ML Compiler Engineer, you will be instrumental in designing, developing, and optimizing features for the compiler. Your responsibilities will include tackling crucial challenges alongside a talented engineering team, contributing to leading-edge design and research in compiler technology and deep-learning systems software. You will also collaborate closely with cross-functional team members from the Runtime, Frameworks, and Hardware teams to ensure system-wide performance optimization. Within the Backend team, you will play a significant role in designing and developing various aspects of the system, including instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programming, code generation, Instruction Set Architectures, new hardware bring-up, and hardware-software co-design.

Requirements

• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related field
• 3+ years of non-internship professional software development experience
• Proficiency with 1 or more programming languages (C++ preferred).
• 2+ years of experience in optimization algorithms, graph-theory, hardware bring-up, FPGA placement and routing algorithms, or hardware resource management

Nice To Haves

• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• M.S. or Ph.D. in computer science or related field
• Strong knowledge in one or more of the areas of: compiler design, instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programing, code generation, Instruction Set Architectures, new hardware bring-up, and hardware-software co-design
• Experience with LLVM and/or MLIR
• Experience with developing algorithms for simulation tools
• Experience is TensorFlow, PyTorch, and/or JAX
• Experience in LLM, Vision or other deep-learning models

Responsibilities

• Design, develop, and optimize features for the compiler.
• Tackle crucial challenges alongside a talented engineering team.
• Contribute to leading-edge design and research in compiler technology and deep-learning systems software.
• Collaborate closely with cross-functional team members from the Runtime, Frameworks, and Hardware teams to ensure system-wide performance optimization.
• Design and develop instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programming, code generation, Instruction Set Architectures, new hardware bring-up, and hardware-software co-design.
• Solve challenging technical problems, often ones not solved before, at every layer of the stack.
• Design, implement, test, deploy and maintain innovative software solutions to transform service performance, durability, cost, and security.
• Research implementations that deliver the best possible experiences for customers.
• Create metrics, implement automation and other improvements, and resolve the root cause of software defects.
• Build high-impact solutions to deliver to our large customer base.
• Participate in design discussions, code review, and communicate with internal and external stakeholders.
• Work cross-functionally to help drive business decisions with your technical input.
• Work in a startup-like development environment, where you’re always working on the most important stuff.

Benefits

• health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• paid time off
• parental leave
• sign-on payments
• restricted stock units (RSUs)

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level