Product Manager

TEKsystems•Dallas, TX

2d•Remote

About The Position

The Product Manager - Data Operations position is a key operational leadership role responsible for the execution, delivery assurance, and day-to-day management of enterprise AI data consulting engagements. While the PM - Data Ops Lead sets the strategic vision, the PM- Data Operations is the "Engine Room" of the practice, ensuring that high-stakes data programs are delivered on time, within scope, and to the exacting quality standards required by Frontier AI clients. In this execution-focused role, you will combine the tactical discipline of a Technical Program Manager with the data-literacy of an Operations Analyst and the linguistic rigor of a Managing Editor. You will own the "Ground Truth" reality of our projects, managing the daily lifecycle of data annotation, RLHF (Reinforcement Learning from Human Feedback), and model evaluation pipelines. You will serve as the primary operational liaison for client engineering teams, ensuring transparency, velocity, and data integrity. The PM Data Ops is expected to have the experience to perform the duties described below for engagements focused on consulting/delivery management within the Frontier AI Data subject matter area, often supporting larger programs led by a PM Data Ops Lead or independently leading mid-sized engagements.

Requirements

Bachelor’s degree in Computer Science, Linguistics, Data Analytics, or a related technical field, or equivalent practical experience.
Approximately 3–7 years of experience in technical program management, product operations, or enterprise service delivery, with specific experience in data-intensive or AI/ML environments.
Hands-on experience with data annotation platforms, editorial workflows, or managing operational teams (e.g., support ops, trust & safety, content moderation).
Strong Sheets/Excel/Tableau skills for reporting; familiarity with JSON/Python for data handling is a strong plus.
Excellent technical judgement.
Proven ability to manage sprint schedules, unblock technical teams, and maintain high quality under tight deadlines.

Nice To Haves

Experience acting as a Team Lead or Operations Manager for large groups of knowledge workers (writers, annotators, analysts).
AI/Data Certification, Certifications in Data Analytics, Agile (CSM, PSM), or CAPM (Certified Associate in Project Management).
Prompt Engineering Familiarity, understanding of LLM prompting techniques (Chain-of-Thought, Few-Shot) and common failure modes (hallucinations, bias).
Experience configuring and managing projects in tools like Jira, Linear, Labelbox, Scale AI, or similar HITL platforms.
Proficiency in multiple languages is a plus for global model evaluation projects.
Experience with AI product management.

Responsibilities

Execute the daily "flywheel" of data ingestion and delivery, actively manage annotation queues, monitor throughput velocities, and identify "blocked" tasks to ensure continuous data flow between client buckets and labeling platforms.
Implement and track the evaluation success metrics (KPIs) defined by the strategic roadmap. Generate daily and weekly reports on model performance, annotator efficiency, and data distribution to provide actionable insights to Research and Engineering stakeholders.
Maintain and version-control complex prompt libraries used for Red Teaming and model stress-testing. Ensure that "Jailbreak" and "Safety" datasets are up-to-date and correctly tagged for regression testing.
Continuously analyze operational data to identify bottlenecks in the labeling workflow. Configure and refine tooling workflows (e.g., Labelbox, Scale, custom UIs) to improve annotator ergonomics and reduce time-per-task (TPT). Identify new product opportunities and manage the product innovation process.
Act as the operational "Managing Editor," translating high-level rubric guides into concrete, enforceable rules for annotators. Update guidelines in real-time based on edge cases and client feedback to ensure consistent tone and factual accuracy.
Oversee the daily quality framework. Monitor Inter-Rater Reliability (IRR) scores, conduct root-cause analysis on disagreements, and manage "Arbitration" queues to resolve complex edge cases.
Own the project RAID log (Risks, Assumptions, Issues, Dependencies). Proactively identify operational risks (e.g., vendor tool outages, low worker supply) and communicate mitigation plans to the PM - Data Ops Lead and client leadership.
Maintain the project "Knowledge Base," ensuring that all delivery methodologies, decision logs, and technical SOPs are documented, understood, and followed by the delivery team from initiation to closeout. And update key artifacts reflecting continuous improvements and lessons learned.
Serve as the primary point of contact for Client TPM Leads and Forward Deployed Engineering Leads regarding daily status, blockers, and sprint planning. Ensure a "No Surprises" culture through transparent and frequent communication.
Assist sales and strategic teams by providing data-driven estimates for effort, timeline, and resource requirements. Lead "Proof of Concept" (POC) executions to demonstrate operational capability to prospective clients.