Test Automation Engineer III

eSimplicity•Columbia, MD

8d•$97,200 - $98,000•Remote

About The Position

The Backend Data Validation and Performance Test Engineer will be responsible for validating and assessing large-scale backend data systems to ensure accuracy, integrity, reliability, and high performance across CMS enterprise applications. This role requires strong expertise in backend database testing, ETL validation, big-data ecosystems, performance benchmarking, and cross-system data comparison between backend outputs and frontend/UI results. The engineer will closely partner with Data Coaches, Data Analysts, DBAs, and Agile delivery teams to ensure all backend data processes meet program, architectural, and CMS compliance standards.

Requirements

All candidates must pass public trust clearance through the U.S. Federal Government. This requires candidates to either be U.S. citizens or pass clearance through the Foreign National Government System which will require that candidates have lived within the United States for at least 3 out of the previous 5 years, have a valid and non-expired passport from their country of birth and appropriate VISA/work permit documentation.
4+ years of hands-on experience in backend data testing or data QA roles.
Experience performing data validation and testing within large-scale data environments, including platforms such as Databricks and Snowflake.
Experience conducting backend performance testing, including workload analysis, query optimization, and data pipeline performance evaluation.
Proficiency with collaboration and work management tools such as Jira, Confluence, and Slack.
Experience working within Agile, SAFe, or similar software development methodologies.
Ability to create clear user stories, defect reports, test documentation, and acceptance criteria.
Experience translating business requirements, functional specifications, and user stories into comprehensive backend test cases.
Strong verbal and written communication skills with the ability to collaborate effectively across cross-functional teams, including Product Owners, Database Administrators, Developers, and Architects.
Ability to manage assigned work independently, prioritize tasks, and deliver quality results within established timelines.

Nice To Haves

Experience documenting test cases and results in TestRail.
Prior experience supporting Centers for Medicare & Medicaid Services (CMS) programs.
Experience with Tableau or Grafana for data visualization, dashboards, and system performance monitoring.
Experience performing security or penetration testing using Burp Suite or similar tools like Postman for API testing.
Section 508 accessibility testing using JAWS or similar tools.

Responsibilities

Perform comprehensive backend data and ETL validation across big-data platforms such as Databricks, Snowflake, PostgreSQL, and similar technologies.
Analyze, interpret, and validate complex CMS datasets, including Shared Systems Claims, Final Action Indicator logic, Provider data, Beneficiary data, and other data assets.
Validate data sourced from CMS’s Integrated Data Repository (IDR) and OnePI (Program Integrity) systems as they relate to Fraud Prevention System (FPS) downstream workflows.
Perform detailed backend-to-frontend comparison testing to ensure accurate and consistent data presentation between backend databases (Snowflake/PostgreSQL) and UI applications or Databricks Unity Catalog outputs.
Execute backend performance testing activities, including: Query performance analysis and optimization recommendations, Benchmarking data processing times and throughput, Load, stress, and volume testing of backend services and data pipelines, Identifying and escalating performance bottlenecks in collaboration with platform and engineering teams.
Collaborate closely with Business Analysts, DBAs, Developers, DevOps engineers, and Scrum/Kanban teams to validate data integrity and ensure optimal backend performance.
Ensure compliance with CMS Testing Frameworks, SDLC processes, quality standards, and federal regulatory requirements.
Support functional UI validations when necessary to maintain end-to-end data alignment throughout the application ecosystem.
Independently develop, execute, and maintain detailed backend test plans, performance testing strategies, and rigorous validation scenarios with minimal oversight.
Create and execute API-based validation scenarios to test backend service operations and data exchanges.
Actively participate in Agile ceremonies, including Daily Standups, Sprint Planning, Backlog Refinement, PI Planning, Sprint Reviews/Demos, and Retrospectives.
Support, mentor, and share subject-matter expertise with backend and functional test teams to strengthen overall quality practices.