ETL Modernization Developer
ZENITH INFOTEK LLC
•$50 - $55•Remote
About The Position
We are seeking an experienced ETL Modernization Developer to join our Data Management team supporting customer’s Enterprise AI & Data initiatives. The role involves modernizing legacy ETL/ELT pipelines, migrating large-scale data workloads, and ensuring operational readiness in a cloud-native environment. The developer will work closely with business, application, and technical teams to deliver high-quality, governed, and production-ready data solutions.
Requirements
- Strong experience in IBM DataStage development.
- Experience in Databricks, Delta Lake, Unity Catalog, Photon
- Proficiency in PySpark, SQL, Shell Scripting and Python.
- Hands-on experience with Databricks Spark (DBX) on AWS for job verification and pipeline development.
- Familiarity with AWS services such as Glue, Lambda, Redshift.
- Knowledge of CI/CD tools (GitLab, ADO, JIRA) and automated testing frameworks.
- Automated ETL Testing tools, PyTest and XML/JSON parsing.
- Expertise in ETL/ELT migration and modernization.
- Understanding of large-scale DB/DWH workloads and complex pipelines.
- Experience in hypercare support and KT with application teams.
- Strong communication and collaboration skills to work with cross-functional teams.
- Ability to document requirements, test plans, and operational readiness artifacts.
- Problem-solving mindset with focus on quality and continuous improvement.
Responsibilities
- Analyze existing ETL/ELT jobs, databases, and data warehouses for migration readiness.
- Document requirements and migration artifacts for approval.
- Redesign and re-engineer legacy IBM DataStage jobs into modern frameworks (Databricks Spark on AWS preferred).
- Develop, test, and deploy ETL pipelines using Python, Unix scripting, and cloud-native tools.
- Implement CI/CD pipelines for automated build, test, and deployment.
- Conduct parity checks, unit testing, functional testing, UAT, and performance testing.
- Ensure schema validation, data quality, regression, and performance test coverage.
- Support migration cutover, go-live, and post-migration stabilization (hypercare).
- Coordinate with application teams for redeployment and complete testing.
- Plan and execute decommissioning of legacy DataStage jobs and artifacts.
- Deliver operational readiness documentation and conduct KT sessions with Customer engineers.
- Provide training support for application and business teams.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
