Sr. Technical Program Manager, AGI-Data Services G-T Quality

Amazon • Boston, MA

23h • Onsite

About The Position

The AGI Data Services organization is responsible for procuring data needed for building and validating large-language models. The vision of the AGI-DS Experts Program is to efficiently organize upstream and downstream dependencies, implement process and tooling improvements, and stay ahead of industry trends in expert data collections, which require annotators and auditors to hold a graduate degree or higher due to the specialized knowledge needed for the work. Today, AGI Data Services leverages expert knowledge to create high-quality data for training and fine-tuning large language models. The program requires coordination across multiple teams, effective dependency management, and continuous process improvement to maximize the value of expert contributions to model performance. This TPM role's scope includes defining strategy for expert data collection, streamlining processes between upstream and downstream dependencies, and leading cross-functional development teams from design through delivery. You will be accountable for researching industry trends in expert data collection, identifying gaps in current processes, and communicating your vision for improvements to multiple directors. Most importantly, you will influence engineering teams to build the right solutions for expert data collection. This position involves regular communication with senior management on status, risks and change control. Success requires strong verbal and written communication in email, WBRs, MBRs, PRFAQs, PRDs, roadmap reviews, and other strategic meetings. Cross-team coordination, project and program management and executive presentation skills are essential.

Requirements

• 5+ years of technical product or program management experience
• 7+ years of working directly with engineering teams experience
• 3+ years of software development experience
• 5+ years of technical program management working directly with software engineering teams experience
• Experience managing programs across cross functional teams, building processes and coordinating release schedules

Nice To Haves

• 5+ years of project management disciplines including scope, schedule, budget, quality, along with risk and critical path management experience
• Experience managing projects across cross functional teams, building sustainable processes and coordinating release schedules
• Experience defining KPI's/SLA's used to drive multi-million dollar businesses and reporting to senior leadership

Responsibilities

• Define strategy for expert data collection.
• Streamline processes between upstream and downstream dependencies.
• Lead cross-functional development teams from design through delivery.
• Research industry trends in expert data collection.
• Identify gaps in current processes.
• Communicate vision for improvements to multiple directors.
• Influence engineering teams to build the right solutions for expert data collection.
• Regular communication with senior management on status, risks and change control.
• Anticipate bottlenecks in the expert program workflow.
• Provide escalation management.
• Make trade-off decisions.
• Balance business needs versus technical constraints.
• Design and implement process and tooling solutions.
• Represent technical requirements to senior leadership.
• Bridge experts, technology, process and operations to achieve the right results.
• Collaborate with internal partners to understand their business priorities, communicate outcomes and define roadmaps.
• Define metrics and performance indicators and establish mechanisms to drive them.
• Dive deep into anecdotes and data to find patterns and root causes of problems.
• Dive deep into science, technology and process to identify problems and create solutions.
• Tirelessly advocate for improvements to systems and processes that will benefit our product teams / stakeholders and business partners.
• Engage with ML Data operations teams to root cause issues, and design solutions.

Benefits

• health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• paid time off
• parental leave
• sign-on payments
• restricted stock units (RSUs)

What This Job Offers

• Job Type: Full-time
• Career Level: Senior