Data Engineer

Empeople Credit Union•Moline, IL

3d•$88,740 - $133,110

About The Position

We are seeking a highly skilled and motivated Data Engineer responsible for supporting the Credit Union and Data & Analytics with efficient data solutions that are dynamic and automated. This role will take part in designing, creating and maintaining a framework for importing and transforming data into tables to be used by our analysts for strategic insights. This role will be creating and scheduling and triggering data pipelines, ETL processes and automated validation/alerting of these processes. AI LLM models are encouraged to be utilized for researching, creating and maintaining ETL data routines when possible. This role will be building, maintaining, and documenting the framework for how data solutions such as API connections, database tables & csv extracts flow into the data warehouse for Data Integration projects. This role will be using Snowflake tools such as Snowpipe, SnowSQL. Openflow, Native SDK for Connectors, & CLI. Currently using Microsoft’s Azure Data Factory for connecting to network sources as well as reviewing other tools. Languages utilized include Python, some Java and heavy SQL for querying and transforming data as well.

Requirements

2 to 4 years writing SQL, utilizing ETL transformation tools & Python for transforming data.
Experience with Data Importing from APIs, files and other data sources, Transformation, Pipelining, Data Extraction and some Data Mining
Experience with Snowflake tools such as Snowpipe, SnowSQL. Openflow, Native SDK for Connectors, & CLI.
Experience with Microsoft’s Azure Data Factory.
Languages utilized include Python, some Java and heavy SQL for querying and transforming data.
Bachelor’s degree in Computer Science, Mathematics, Business, or equivalent experience.
A minimum of two years of related experience in a financial institution.
Bondable
Acceptable Credit History
Core CU systems, databased protocol, and programming capability
Must be able to work on multiple projects, strong problem-solving ability.
Communication Skills
Mathematical Skills
Reasoning & Troubleshooting Ability

Nice To Haves

Experience in financial institutions preferred
Experience with Snowflake and Azure Data Factory preferred.

Responsibilities

Designing, creating and maintaining a framework for importing and transforming data into tables to be used by analysts for strategic insights.
Creating and scheduling and triggering data pipelines, ETL processes and automated validation/alerting of these processes.
Building, maintaining, and documenting the framework for how data solutions such as API connections, database tables & csv extracts flow into the data warehouse for Data Integration projects.
Partnering with business users, programming, technology teams, data analysts, and project management teams to define requirements and develop and implement solutions within a mature agile framework.
Creating and maintaining an automated ETL framework within Snowflake and other ETL tools based on business transformation rules.
Utilizing the version control function within the ETL tools manage and track data automation revisions.
Working with business partners to maintain Data Warehouse configuration documentation.
Utilizing Azure Data Factory, Snowflake & Python tools to create data automations and reports.
Utilizing Python programs to perform custom transformations with data.
Validating and cleansing data and other alert automations with predefined quality assurance checks to ensure clean and consistent data availability.
Optimizing on-time delivery of data for analyst team and custom extracts to 3rd party systems.
Diagnosing and troubleshooting data-related issues.
Perform other duties as assigned and support all areas of the credit union.
Locate and define new process improvement opportunities.