Lead Data Quality Assurance Engineer, Data Annotation Services

Caterpillar Inc.•Irving, TX
•$128,470 - $208,770•Onsite

About The Position

At Caterpillar, the Lead Data Quality Assurance Engineer will lead the quality strategy for training data that powers robotics, computer vision, autonomous systems, Physical AI, and Vision-Language-Action (VLA) models. The role combines data quality engineering, test automation, and machine learning expertise to ensure AI datasets are accurate, scalable, and trustworthy. It also provides technical leadership and mentorship to a small team of QA engineers and involves collaboration across engineering, annotation, product, and vendor teams. The position leads the development and execution of quality assurance processes, standards, and automation frameworks for annotation and captioning datasets supporting robotics, autonomous driving, computer vision, and Physical AI initiatives. It drives continuous dataset-quality improvement through metrics, evaluation of AI-assisted labeling technologies, vendor quality management, and scalable validation across the data lifecycle. This position is full-time and onsite in Irving, Texas (Dallas). Domestic relocation assistance and visa sponsorship are available.

Requirements

  • Bachelor’s degree in Computer Science, Software Engineering, Data Science, Artificial Intelligence, Robotics, or a related technical field.
  • At least 5 years of experience in data quality engineering, annotation quality assurance, or test automation for computer vision, robotics, autonomous systems, Physical AI, or machine learning environments.
  • Experience leading small technical teams, providing mentorship, setting technical direction, and collaborating with external vendors or distributed teams.
  • Strong Python development skills, including experience building automated validation frameworks and data quality tooling, and producing production-grade software using modern engineering practices and containerized environments.
  • Experience with annotation platforms such as Labelbox, Supervisely, Roboflow, or similar; SQL; data analysis tools; and machine learning evaluation metrics such as precision, recall, IoU, F1, and mAP.
  • Experience validating perception datasets that include camera and LiDAR sensor data and investigating data quality issues across collection, annotation, and processing workflows.

Nice To Haves

  • Experience with computer vision, robotics, autonomous driving, multimodal AI, Physical AI, and 3D perception systems.
  • Experience evaluating AI-assisted annotation workflows, auto-labeling technologies, agentic AI systems, or LLM/VLM-based quality automation solutions.
  • Familiarity with ML frameworks and tooling such as PyTorch, TensorFlow, ONNX, MLflow, or Weights & Biases.
  • Experience with Vision-Language-Action (VLA) datasets, caption quality evaluation, sensor fusion, and autonomous machine data pipelines.
  • Experience building human-in-the-loop quality processes, managing annotation vendor performance, and working with cloud-based data platforms and MLOps environments.

Responsibilities

  • Lead the annotation quality strategy and roadmap, provide technical leadership and mentorship to QA engineers, and define standards, guidelines, acceptance criteria, and governance processes for perception and VLA datasets.
  • Design and implement automated validation frameworks, testing methodologies, and quality gates to verify annotation accuracy, consistency, completeness, schema compliance, and sensor synchronization across multimodal datasets.
  • Define and monitor dataset quality metrics, dashboards, audits, and benchmarking processes; identify root causes of labeling defects and drive continuous quality improvements with internal teams and external annotation providers.
  • Evaluate and validate human, AI-assisted, and automated labeling solutions, including NVIDIA Cosmos Curator and Cosmos Reason.
  • Help develop AI-driven QA capabilities and agentic workflows for scalable review and defect analysis.
  • Partner with machine learning, platform, product, and vendor teams to integrate quality processes into data pipelines, communicate risks and tradeoffs, and deliver trusted datasets for AI model development.

Benefits

  • Medical, dental, and vision benefits
  • Paid time off plan, including vacation, holidays, and volunteer time
  • 401(k) savings plans
  • Health Savings Account (HSA)
  • Flexible Spending Accounts (FSAs)
  • Health Lifestyle Programs
  • Employee Assistance Program
  • Voluntary Benefits and Employee Discounts
  • Career Development
  • Incentive bonus
  • Disability benefits
  • Life Insurance
  • Parental leave
  • Adoption benefits
  • Tuition Reimbursement
  • Domestic relocation assistance
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service