Remote | QA Test Engineer — $25–$55/hour

24-Mag • New York, NY

3d • Remote

About The Position

We are sharing a specialised consulting opportunity for experienced QA Engineers, Software Engineers, SDETs, and Test Automation Engineers with strong expertise in browser automation and modern web application testing. This role supports an advanced AI initiative focused on validating browser-based testing workflows for AI-generated web applications. Selected professionals will review automated tests for technical feasibility, determinism, reliability, isolation, and clear pass/fail behaviour before those workflows are incorporated into evaluation datasets.

Requirements

• At least 3 years of professional experience in QA Engineering, Software Engineering, SDET, Test Automation, or a closely related role.
• Strong experience testing modern web applications.
• Hands-on experience with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.
• Experience writing automated UI and end-to-end tests.
• Strong understanding of test isolation, fixtures, reproducibility, and deterministic testing.
• Ability to identify flaky tests, hidden dependencies, and ambiguous assertions.
• Excellent debugging and technical problem-solving skills.
• Strong attention to detail and written communication.

Nice To Haves

• Advanced experience with Playwright.
• Experience with Cypress or Selenium.
• Background designing browser automation frameworks.
• Experience testing complex single-page applications.
• Familiarity with CI/CD-based automated testing.
• Knowledge of test environments, fixtures, mocks, and state management.
• Experience reviewing or maintaining large automated testing suites.
• Prior experience with AI evaluation, benchmark development, or structured technical review.

Responsibilities

• Browser Test Validation: Review browser-based testing workflows for modern web applications, assess technical feasibility and reliability, verify test sequences, identify inconsistent results, and evaluate overall technical quality.
• Test Automation Review: Review automated UI and end-to-end testing implementations, evaluate workflows built with Playwright, Cypress, Selenium, or comparable frameworks, assess test setup and dependencies, identify coupling, and verify reproducibility.
• Reliability & Determinism: Confirm clear pass/fail outcomes, identify flaky tests and sources of nondeterministic behaviour, evaluate test isolation and state management, review timing and selectors, and ensure validation logic accurately measures intended behaviour.
• Technical Review & Feedback: Debug problematic testing workflows, identify underlying technical issues, assess if failures represent genuine application problems or test weaknesses, provide structured technical feedback, document errors, and apply consistent software-quality judgment.

Benefits

• Flexible remote consulting work.
• Competitive hourly compensation.
• Independent contractor role.
• Fully remote with flexible scheduling.
• Competitive rates between $25–$55 per hour depending on expertise and project scope.
• Weekly payments via Stripe or Wise.
• Projects may be extended, shortened, or adjusted depending on scope and performance.
• Work will not involve access to confidential or proprietary information from any employer, client, or institution.

What This Job Offers

• Career Level: Senior
• Education Level: No Education Listed