Data Engineer

Innova Solutions•Charlotte, NC

15h•Hybrid

About The Position

A client of Innova Solutions is immediately hiring for a Data Engineer. This is a Full Time – Contract position with a duration of 24+ months, located in Charlotte, NC. The role is hybrid, requiring 3 days onsite and 2 days remote. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable batch and near real-time ETL pipelines using Ab Initio, Python, PySpark, SQL, and PL/SQL. You will consolidate, cleanse, normalize, and transform data from mortgage-related systems into enterprise data products. Additionally, you will support migration from legacy platforms to GCP, leveraging BigQuery, Dataplex, and cloud-native orchestration. The role involves building, scheduling, and deploying solutions through enterprise CI/CD pipelines (Jenkins, Harness, uDeploy) and partnering with Product Owners, Architects, Engineers, and business stakeholders across U.S. and India-based Scrum teams. You will also support monitoring, incident response, root cause analysis, and production reliability.

Requirements

Data Engineering experience.
Experience in PL/SQL and SQL with Oracle, Teradata, Python, and/or BigQuery (complex query development, tuning, debugging).
Experience in Ab Initio (complex graphs, Psets, performance tuning).
Experience in Unix Shell scripting.
Experience in Python and PySpark for distributed data processing.
Experience in ETL design, data warehousing concepts, and data modeling best practices.
Experience in Financial Services or Mortgage industry experience.
Experience in hybrid environments (on-prem + cloud) and modernization initiatives.
Scheduling/orchestration with Autosys and Airflow/Cloud Composer.
Git-based workflows, code reviews, automated testing practices.
CI/CD with Harness, Jenkins, uDeploy.
Ab Initio migration to modern Spark/SQL patterns.
Data governance with Dataplex and Informatica Data Quality.
Experience designing near real-time patterns (micro-batch/event-driven).
Familiarity with GCP operational practices (IAM, monitoring, quota/cost controls).

Responsibilities

Design, build, and maintain scalable batch and near real-time ETL pipelines using Ab Initio, Python, PySpark, SQL, and PL/SQL.
Consolidate, cleanse, normalize, and transform data from mortgage-related systems into enterprise data products.
Support migration from legacy platforms to GCP, leveraging BigQuery, Dataplex, and cloud-native orchestration.
Build, schedule, and deploy solutions through enterprise CI/CD pipelines (Jenkins, Harness, uDeploy).
Partner with Product Owners, Architects, Engineers, and business stakeholders across U.S. and India-based Scrum teams.
Support monitoring, incident response, root cause analysis, and production reliability.