Tubi, Inc.-posted 15 days ago
Full-time • Mid Level
Hybrid • San Francisco, CA
501-1,000 employees
Broadcasting and Content Providers

Tubi is seeking a highly skilled and experienced Senior QA Analyst to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences, robust streaming playback, and the accuracy and integrity of our AI/ML features across web, mobile, and OTT platforms. We're seeking a candidate with a strong background in streaming QA and a deep technical understanding of media workflows. You'll be instrumental in collaborating with engineering, product, and data science teams to define comprehensive QA strategies that guarantee both functional excellence and data-level quality. This is a hybrid role based out of our San Francisco office. You must be willing to travel to our San Francisco office 3 days a week.

  • Design and lead test strategies for streaming workflows, playback systems, and AI-powered features.
  • Test across platforms (web, mobile, and connected TV) to ensure functional parity and playback stability.
  • Validate streaming performance-including ABR logic, encoding pipelines, and DRM integrations-under diverse real-world conditions.
  • Debug with precision using tools like Charles Proxy, Chrome DevTools, ADB, and Xcode. Collaborate with data and ML teams to validate AI model updates, recommendations, and personalization accuracy.
  • Leverage AI-assisted QA tools to enhance regression coverage, UI validation, and anomaly detection.
  • Contribute to automation and CI/CD frameworks, driving faster, more reliable releases.
  • Oversee QA deliverables for multiple concurrent releases and ensure seamless sign-off for production launches.
  • Monitor live environments for playback or recommendation anomalies post-release and escalate issues promptly.
  • Continuously improve QA processes, metrics, and reporting for streaming and AI validation.
  • Bachelor's degree in Computer Science, Software Engineering, or related field, or equivalent hands-on experience
  • 4+ years of QA experience, preferably in streaming media or VOD/OTT platforms
  • Strong technical knowledge of video streaming protocols (HLS, DASH, MPEG-TS), DRM systems, and CDN architectures
  • Experience validating AI/ML systems in production - e.g., testing model output accuracy, user personalization logic, and algorithm stability
  • Hands-on experience with test automation tools (Selenium, Appium, Playwright, Puppeteer) and AI-based visual testing
  • Proficiency in debugging tools and network analysis utilities (Charles Proxy, Chrome DevTools)
  • Experience managing regression suites and release validation cycles across web, mobile, and connected TV platforms
  • Familiarity with Python, Typescript or JavaScript for scripting and test automation
  • Understanding of data validation, logging pipelines, and A/B testing frameworks
  • Strong analytical and documentation skills, with a proactive approach to cross-team collaboration
  • Experience testing machine learning-driven streaming features such as recommendation systems, ad targeting, or automated metadata tagging
  • Exposure to model evaluation techniques (precision/recall, bias testing, data drift analysis)
  • Familiarity with continuous testing and CI/CD environments (Jenkins, GitHub Actions, CircleCI)
  • Understanding of observability tools (Grafana, Kibana, Datadog) for post-deployment validation
  • Strong ability to triage issues in large distributed systems and collaborate with engineering to resolve root causes
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service