Senior Software Development Engineer, AGI Data Services

Amazon • Boston, MA

10d • Onsite

About The Position

AGI Data Services strives to be best in class at acquiring, creating and ground-truth data, with the highest standards of privacy and trust, to power the best AI models on Earth. We are seeking a Senior Software Development Engineer (Sr. SDE) who is passionate about Generative AI and has strong engineering fundamentals to accelerate the creation of rich Software Engineering datasets used to train Amazon's Models. The Sr. SDE will design, build, and maintain systems to mine software engineering data, and to assess data quality using a combination of models and humans in the loop. The Sr. SDE will also design and build GenAI-powered workflow tools — such as conversational diagnostic agents, automated quality assessment systems, and guided remediation workflows — that streamline data collection and quality assurance processes, enabling cross-functional teams to rapidly identify issues, reduce resolution time, and continuously improve data throughput. The Sr. SDE's work will directly improve Amazon Nova models. Our team has built a strong foundation of GenAI-powered engineering practices — this senior role will accelerate and scale that momentum. This role offers direct visibility to VP and SVP leadership.

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language experience
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience as a mentor, tech lead or leading an engineering team
• Bachelor's degree in computer science or equivalent

Nice To Haves

• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Master's degree
• Knowledge of Machine Learning and LLM fundamentals, including transformer architecture, training/inference lifecycles, and optimization techniques
• Knowledge of general AI tools

Responsibilities

• Identifying high quality software engineering data that is valuable for model training (specifically Reinforcement Learning, but also other types of training) — designing, building, and scaling automated systems that mine and curate high quality datasets.
• Architecting judge pipelines, developing evaluation rubrics and scoring frameworks, building calibration and agreement mechanisms to eventually ensure Amazon models improve on key software engineering capabilities.
• Collaborating with Applied Scientists, Technical Program Managers, domain experts, and vendor teams — bridging technology, process, and operations.
• Defining strategy, using spec driven development with coding agents to develop tooling to identify and link high value SWE data for reinforcement learning, and delivering working training data to the modeling team.
• Diving deep into data quality anecdotes to find patterns and root causes, proposing improvements.
• Communicating impact and roadmaps to cross-functional partners.
• Appropriately leveraging other SDEs for human in loop judgement to improve data.
• Communicating regularly with Sr leadership on the approaches they define.

Benefits

• health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• paid time off
• parental leave
• sign-on payments
• restricted stock units (RSUs)

What This Job Offers

• Job Type: Full-time
• Career Level: Senior