Lead / Principal AI Quality Engineer - San Jose & Chicago

Lenovo•Chicago, IL

7d•$160,700 - $246,445•Hybrid

About The Position

We are looking for an Senior Quality Engineer with solid experience testing mobile, device, or cloud systems. This role focuses on writing tests, maintaining automation, validating features, and identifying issues early. You will work closely with developers, product teams, and senior QEs to ensure strong test coverage and quality across Qira. We recently introduced Qira, our new cross‑device Personal AI that works seamlessly across Lenovo and Motorola products.

Requirements

8+ years in Quality Engineering or Software Testing.
Bachelor's Degree in Engineering or Technical Discipline.
Experience writing structured test cases and performing manual and automated tests.
Basic automation experience (Python, Java, JavaScript, or similar).
Experience testing Android (Mobile and Tablets), Windows (PC), or cross‑device applications.
Hands-on experience testing AI models, RAG/LLM systems, perception models, or agentic behaviors.

Nice To Haves

Experience testing AI‑driven features or task workflows.
Familiarity with automated test frameworks and CI/CD pipelines.
Exposure to performance or reliability testing.
Familiarity with cloud systems, logs, and debugging tools.
Strong communication and documentation skills.

Responsibilities

Write and execute functional, regression, integration, and exploratory tests.
Test Qira features across device, mobile, and cloud environments.
Help maintain and expand automated test suites.
Validate AI workflows, cross‑device features, and user scenarios.
Reproduce, document, and track defects through resolution.
Analyze logs, crashes, and behaviors to support engineering teams.
Provide quality status during testing cycles and release checkpoints.
Drive model and agent evaluation pipelines, including accuracy, latency, grounding, hallucination detection, safety checks, and guardrail tests.