Senior AI Test Automation Engineer

CarParts.com•Long Beach, CA

4d•Onsite

About The Position

CarParts.com is seeking a Senior AI Test Automation Engineer to join their rapidly growing team. This role is at the forefront of AI-powered engineering, focusing on building intelligent agents, integrating LLMs, and developing systems to orchestrate automation across their e-commerce platform. The position involves a blend of full-stack engineering and applied AI, with AI being integral to how tests are written, run, and maintained. The ideal candidate will be a builder and troubleshooter with a passion for AI and a desire to create quality systems that impact millions of customers.

Requirements

Bachelor's degree in Computer Science, Software Engineering, or related field / equivalent experience.
6+ years of software engineering experience with deep, hands-on test automation expertise.
Proficient in programming using JavaScript / Node.js; experience with TypeScript strongly preferred.
In-depth, hands-on expertise with Cypress and Playwright, including fixtures, network interception, parallelization, and cross-browser execution.
Proven experience with mocking and stubbing libraries and contract testing for APIs.
Proven experience creating test automation for microservice APIs, for end-to-end testing or testing API services in isolation using mocks.
Proven experience creating test automation for one or more application types: Single Page Application (SPA), Progressive Web App (PWA), responsive design, and Multi-Page Application (MPA).
Proven experience using Git source control and continuous integration tools (Jenkins, GitHub Actions, GitLab CI).
Solid understanding of software testing methodologies, test planning, and test case design.
Strong communication and collaboration skills to work effectively with cross-functional teams.
Excellent problem-solving and analytical skills to identify and troubleshoot issues.
Experienced working in Scrum teams; able to adapt to evolving project requirements and priorities.
Strong organizational and leadership skills.
Comfortable working on the command line.
Hands-on experience using LLMs (OpenAI, Anthropic, or equivalent) to generate, refactor, and maintain test code.
Comfortable using AI coding assistants (GitHub Copilot, Claude Code, Claude Cowork, Cursor) daily to accelerate test development.
Able to write effective prompts for test generation, test data creation, refactoring, and documentation.
Demonstrated ability to build or extend AI-assisted testing workflows, such as test generation from requirements, intelligent test selection, automated failure triage, and self-healing locators.
Familiar with agentic concepts: tool-calling, structured output, multi-step task decomposition, and human-in-the-loop review checkpoints.
Understands foundational LLM concepts: tokens, temperature, context windows, embeddings, and RAG.
Can evaluate AI-generated tests and code for correctness, security, and coverage, not just accept output blindly.

Nice To Haves

Experience with Selenium, Appium, Jest, or Puppeteer.
Proven experience testing applications built with frameworks like Express, Next.js, and React.
Experience designing or contributing to MCP servers or similar context-orchestration layers.
Experience with performance testing tools (k6, JMeter, Lighthouse).
Experience with public cloud services (AWS, Azure, GCP).
Experience with ecommerce/retail purchase journeys.

Responsibilities

Design, develop, and maintain automated test suites in Cypress and Playwright for functional, regression, end-to-end, and cross-browser testing.
Build robust, scalable test frameworks including custom commands, fixtures, page objects, network interception, and mocking/stubbing.
Create test automation for microservice APIs, testing end-to-end or in isolation using mocks, stubs, and contract testing.
Cover SPA, PWA, responsive design, and MPA architectures across desktop and mobile browsers.
Integrate automated tests into CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI) and monitor their execution.
Develop and execute performance and load testing scripts.
Perform targeted manual, exploratory, and UAT/production validation.
Automate test writing by building and refining AI agents and pipelines that generate test specs from various inputs.
Automate test running through intelligent test selection, automated failure triage, flaky-test detection, and self-healing locators.
Write prompts, evaluation harnesses, and monitoring for AI-assisted testing workflows.
Evaluate AI-generated tests for correctness, coverage, and reliability.
Build shared tooling powered by AI, such as CLI utilities and test data generators.
Contribute to MCP servers and integrations that expose test infrastructure to LLM-powered clients.
Work closely with developers to understand application architecture and expand test coverage.
Participate in design and code reviews.
Contribute to test planning and strategy discussions.
Investigate and analyze defects, documenting and reporting issues.
Mentor engineers on test automation and AI-assisted testing patterns.
Adhere to department procedures, processes, and best practices.
Stay current with AI/ML tooling, LLM advances, and testing ecosystem developments.