Senior Staff Engineer - Senior QA Automation Tester
About The Position
We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work on a scale across all devices and digital mediums, and our people exist everywhere in the world (17000 plus experts across 39 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in! Role - Senior QA Automation Tester Job Overview: Role Summary We are looking for an Application Tester / QA Engineer who can ensure the quality, reliability, and correctness of web applications, mobile and Gen AI-enabled systems. The role requires a strong analytical mindset, hands-on experience with automated testing frameworks, features. What You’ll Do Web & UI Testing: Test UI workflows using Selenium, Cypress, or Playwright. Validate cross-browser behaviour, UI responsiveness, and user interaction flows. Identify UI edge cases, broken states, and usability issues. GenAI / NLP Output Validation Test NLP and GenAI-powered features, including o Chat-based interfaces o Text generation, summarization, and extraction outputs Validate LLM outputs for: o Functional correctness o Format and schema adherence o Edge cases and failure scenarios Design test cases for non-deterministic outputs, including prompt variations and response consistency. Identify hallucinations, incorrect grounding, and unsafe responses where applicable. Defect Tracking & QA Governance: Document defects clearly with reproducible steps, expected vs actual results, and logs. Maintain test plans, test cases, and QA reports. Support QA governance through structured documentation and reporting. Track test coverage and quality metrics across releases.
Requirements
- Minimum 7 years of experience as a QA Automation.
- AI testing exposure, API Testing (Capable), Playwright with Java, Python (Strong)
- Experience testing web applications and mobile testing.
- Hands-on experience with Postman for API validation.
- Familiarity with Selenium for UI automation.
- Strong analytical skills for identifying edge cases and failure scenarios.
- Ability to write clear, structured test documentation and defect reports.
- Ability to write clear, structured test documentation and defect reports.
Nice To Haves
- Experience testing NLP or GenAI-based applications.
- Familiarity with validating LLM outputs, prompts, and structured responses.
- Experience with CI/CD-integrated testing.
- Exposure to performance or load testing tools.
- Understanding of basic database validation for test verification.
Responsibilities
- Web & UI Testing: Test UI workflows using Selenium, Cypress, or Playwright.
- Validate cross-browser behaviour, UI responsiveness, and user interaction flows.
- Identify UI edge cases, broken states, and usability issues.
- GenAI / NLP Output Validation Test NLP and GenAI-powered features, including o Chat-based interfaces o Text generation, summarization, and extraction outputs Validate LLM outputs for: o Functional correctness o Format and schema adherence o Edge cases and failure scenarios Design test cases for non-deterministic outputs, including prompt variations and response consistency.
- Identify hallucinations, incorrect grounding, and unsafe responses where applicable.
- Defect Tracking & QA Governance: Document defects clearly with reproducible steps, expected vs actual results, and logs.
- Maintain test plans, test cases, and QA reports.
- Support QA governance through structured documentation and reporting.
- Track test coverage and quality metrics across releases.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
Number of Employees
5,001-10,000 employees
