Software Development Engineer III, Annapurna Labs

Amazon • New York, NY

21h

About The Position

You will join a dynamic team working at the cutting edge of the GenAI revolution
by applying AI to AI. You will work on building agents, tools, and models to
simplify and accelerate customer adoption of Neuron, the software stack
supporting Amazon's Machine Learning silicon: Trainium. Partnering with external
and internal customers, you will identify key obstacles and opportunities to
accelerate their migration to AWS's ML silicon. You will be the technical lead
for a team building AI agents and tools that simplify AWS Neuron adoption, and
drive the team's vision and strategy in this space critical to AWS's Generative
AI business.

Requirements

• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Experience as a mentor, tech lead or leading an engineering team
• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language experience
• Hands-on technical experience working in the Generative AI space
• Excellent written and verbal communication skills with the ability to present complex technical information concisely to executives and non-technical leaders.
• Experience in one or more of the following areas: ML compilers, production coding agents, GenAI model architecture, model training, neural network optimization, or alternatively applied math.

Nice To Haves

• Master's degree in computer science or equivalent
• Master's degree or above in computer science or equivalent
• 2+ years in machine learning or other computational modeling environments with an emphasis on hosting, building or optimizing models for diverse hardware platforms
• Proven track record in building AI agents that automate ML workload optimization, ML compiler tuning, distributed inference and training, or ML kernel authoring and optimization
• Experience working with open-source software communities in the optimization space or related areas
• Domain-level knowledge of AWS services
• Knowledge of the state-of-the-art technology used in the Machine Learning space and its mathematical underpinning

Responsibilities

• Research implementations that deliver the best possible experiences for customers.
• Deliver on goals to improve the time and effort it takes to port and optimize Machine Learning workloads on Neuron.
• Solve challenging technical problems, often ones not solved before, at every layer of the stack
• Design, implement, test, deploy and maintain innovative software solutions to transform service performance, durability, cost, and security.
• Build high-quality, highly available, always-on products.
• Potentially contribute intellectual property through patents
• Assist in the career development of others, actively mentoring individuals and the community on advanced technical issues and helping managers guide the career growth of their team members.
• Exert technical influence over the team, increasing their productivity and effectiveness by sharing your deep knowledge and experience.

Benefits

• health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• paid time off
• parental leave

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level