Automation Testing Engineer
About The Position
As an Automation Testing Engineer, you will be responsible for designing, implementing, and executing automated test solutions across a modern data platform. Your role will involve working closely with tools such as Databricks, PySpark, Delta Lake, and CI/CD pipelines to ensure the accuracy and reliability of complex data pipelines, analytics systems, and BI reporting solutions. You will play a crucial part in building scalable automated test frameworks, validating data transformations, and proactively identifying data quality issues within distributed systems and enterprise data workflows. Collaboration with Data Engineers, Architects, QA Analysts, and Business Analysts will be essential to define test cases based on business logic and data requirements. To excel in this role, you should have strong experience with Python, SQL, and data platforms. Exposure to building comprehensive test coverage using Python, SQL, and PySpark for validating data pipelines, ETL/ELT processes, and Data Lakehouse transformations will be beneficial. Additionally, experience in developing and executing automated test plans for data ingestion, transformation, and consumption layers will help you succeed in this position. You will also need to have the ability to validate data transformations within Delta Lake tables, ensuring schema changes and data integrity are handled appropriately. Monitoring production pipelines, participating in defect triage, root cause analysis, and resolution of data quality issues will be part of your responsibilities. Documenting test strategies, test cases, test results, defect logs, and maintaining trace for audit and compliance purposes will also be crucial in this role.
Requirements
- Strong Python, SQL, and Databricks experience
- Bachelor's Degree and one year of relevant work experience OR 5 years of relevant work experience
- US citizenship
Nice To Haves
- Experience building scalable automated test frameworks.
- Ability to validate complex data transformations
- Knowledge of data quality issues and root cause analysis.
- Ability to design, implement, and execute automated test solutions
- Knowledge of data pipelines, ETL/ELT processes, and data Lakehouse transformations
- Experience with BI platforms such as QuickSight, Tableau, or Power BI
Responsibilities
- Designing, implementing, and executing automated test solutions across a modern data platform
- Working closely with tools such as Databricks, PySpark, Delta Lake, and CI/CD pipelines
- Building scalable automated test frameworks
- Validating data transformations
- Proactively identifying data quality issues within distributed systems and enterprise data workflows
- Collaborating with Data Engineers, Architects, QA Analysts, and Business Analysts to define test cases based on business logic and data requirements
- Validating data transformations within Delta Lake tables, ensuring schema changes and data integrity are handled appropriately
- Monitoring production pipelines
- Participating in defect triage, root cause analysis, and resolution of data quality issues
- Documenting test strategies, test cases, test results, defect logs, and maintaining trace for audit and compliance purposes
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Entry Level
