Sr. Technical Program Manager, AGI-Data Services G-T Quality

Amazon • Boston, MA

11h

About The Position

The AGI Data Services organization is responsible for procuring data needed for building and validating large-language models. The vision of the AGI-DS Experts Program is to efficiently organize upstream and downstream dependencies, implement process and tooling improvements, and stay ahead of industry trends in expert data collections, which require annotators and auditors to hold a graduate degree or higher due to the specialized knowledge needed for the work.. Today, AGI Data Services leverages expert knowledge to create high-quality data for training and fine-tuning large language models. The program requires coordination across multiple teams, effective dependency management, and continuous process improvement to maximize the value of expert contributions to model performance. This TPM role's scope includes defining strategy for expert data collection, streamlining processes between upstream and downstream dependencies, and leading cross-functional development teams from design through delivery. You will be accountable for researching industry trends in expert data collection, identifying gaps in current processes, and communicating your vision for improvements to multiple directors. Most importantly, you will influence engineering teams to build the right solutions for expert data collection. This position involves regular communication with senior management on status, risks and change control. Success requires strong verbal and written communication in email, WBRs, MBRs, PRFAQs, PRDs, roadmap reviews, and other strategic meetings. Cross-team coordination, project and program management and executive presentation skills are essential. Key job responsibilities The Sr. Technical Program Manager will interact with expert contributors, product management, program management, cross partner teams, multiple stakeholders and leadership to deliver complex projects and programs. The person will anticipate bottlenecks in the expert program workflow, provide escalation management, make trade-off decisions, and balance business needs versus technical constraints. The person should have technical skills to design and implement process and tooling solutions. Successful candidates will have a strong technical background, be detail driven and have excellent problem solving abilities. You will have a deep understanding of expert data collection processes and will successfully represent technical requirements to senior leadership. Your technical expertise and operational excellence will influence the team's decisions and drive robust solutions for expert data collection. They are responsible for bridging experts, technology, process and operations to achieve the right results. A day in the life - Collaborate with internal partners to understand their business priorities, communicate outcomes and define roadmaps. - Define metrics and performance indicators and establish mechanisms to drive them. - Dive deep into anecdotes and data to find patterns and root causes of problems. - Dive deep into science, technology and process to identify problems and create solutions. Tirelessly advocate for improvements to systems and processes that will benefit our product teams / stakeholders and business partners. - Engage with ML Data operations teams to root cause issues, and design solutions.

Requirements

• 5+ years of people management experience
• 5+ years of technical program management experience
• Bachelor's degree in Engineering, Computer Science, or a related technical field
• Experience in people management
• Experience in technical program management
• Experience managing efforts in Unix/Linux environments, distributed systems or developing large-scale web applications
• Experience communicating across technical and non-technical audiences, including executive level stakeholders or clients
• Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules
• Experience with Agile or other program management methodologies

Nice To Haves

• Knowledge of the AWS product suite
• Knowledge of data center infrastructure design, operations, or delivery

Responsibilities

• Collaborate with internal partners to understand their business priorities, communicate outcomes and define roadmaps.
• Define metrics and performance indicators and establish mechanisms to drive them.
• Dive deep into anecdotes and data to find patterns and root causes of problems.
• Dive deep into science, technology and process to identify problems and create solutions.
• Tirelessly advocate for improvements to systems and processes that will benefit our product teams / stakeholders and business partners.
• Engage with ML Data operations teams to root cause issues, and design solutions.

Benefits

• health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• paid time off
• parental leave

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level