Software Dev Engineer, Machine Learning Compilers

Amazon • Sunnyvale, CA

4d • $165,200 - $223,600 • Onsite

About The Position

Amazon Devices is an inventive research and development company that designs and engineers high-profile consumer products like the Kindle family, Fire Tablets, Fire TV, Health & Wellness devices, Amazon Echo, and Astro. We are building the next generation of edge AI capabilities through our advanced compression platform, compiler and custom neural accelerator silicon. Come join us to accelerate deep learning networks on edge processors and beyond. We are looking for a talented and passionate software engineer to be part of an exciting technology creation team at Amazon. You will have an enormous opportunity to make a large impact on the design, architecture, and implementation of deep learning technologies embedded into consumer products used every day, by people you know. The position provides an unique opportunity to contribute and make an impact from hardware design stage followed by pre and post silicon development as well as productizing it on consumer devices. In this role you will be work along side partner science teams to develop the compiler infrastructure and lower deep learning workloads to heterogeneous device backends. You will also partner up with peer science teams to innovate on model quantization and compression techniques for efficient execution on hardware.

Requirements

• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 3+ years of non-internship professional software development experience
• 3+ years of programming using a modern programming language such as Java, C++, or C#, including object-oriented design experience
• Experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware

Nice To Haves

• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent
• Experience in embedded development in C/C++
• Experience building compiler for application specific accelerators or custom instruction set

Responsibilities

• Design and develop software stack for deep learning accelerator
• Develop Compiler passes for graph ingestions, optimizations and partitioning.
• Develop backend code generation capabilities across heterogeneous platforms
• Profile, analyze and optimize system level performance, develop new tooling where necessary
• Participate in design reviews, API development, and documentation
• Successfully collaborate with hardware, software, applied science and product teams to onboard more and more user experiences to be powered by Deep Learning accelerator.
• Mentor and provide guidance to junior engineers

Benefits

• health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• paid time off
• parental leave
• sign-on payments
• restricted stock units (RSUs)

What This Job Offers

• Job Type: Full-time
• Career Level: Entry Level
• Education Level: Associate degree