Data Engineer (Snowflake, Azure, ETL, SQL) | REMOTE

Codetech•Minneapolis, MN

9h•Remote

About The Position

This remote Data Engineer will develop and test ETL processes for a Program Integrity data mart using Snowflake and SQL Server. The role uses mapping documents to build data loads, creates balancing routines to run after each load, and includes procedures for summarizing data. The engineer will work with data analytics and QA teams to verify data accuracy and will create Azure Data Factory (ADF) pipelines to move data between SQL Server and Snowflake. The position leads the development and management of data pipelines and ETL operations, including Peer Group Profiling procedures and outputs. It also involves applying DevOps practices, monitoring and optimizing workflows, resolving technical issues, and collaborating across teams. The engineer is responsible for accurate and reliable deliverables, cloud-based project execution, and data security and compliance.

Requirements

More than 5 years of hands-on experience in cloud-based data engineering and data warehousing.
More than 2 years of Snowflake experience, including designing, developing, and maintaining automated data ingestion workflows using Snowflake SQL procedures and Python scripting.
Practical experience with Azure Data Factory, SQL Server, Blob Storage, and Snowflake.
Experience managing CSV, JSON, and VARIANT data formats and performing data loading and exporting with SnowSQL, orchestrated through ADF.
Proficiency with Python and other scripting languages for data manipulation and automation.
Experience developing cloud-native ETL processes and data pipelines using Azure and Snowflake technologies.
Experience with data science and analytics tools such as Snowpark, Apache Spark, pandas, NumPy, and Scikit-learn for complex data processing and modeling.
Strong analytical thinking and independent problem-solving skills.
Strong interpersonal, communication, and teamwork skills.
Experience delivering cloud projects to performance and quality standards.
Working knowledge of medical claims processing systems, including their core functionalities, workflows, and data structures.
Experience setting up DDL, mapping data, and creating ETL procedures in Snowflake and SQL Server.
Experience creating balancing procedures with medical claims data and resolving balancing issues.
Ability to explain processes to both technical and non-technical staff.

Nice To Haves

Azure or Snowflake certification.
Experience with data modeling and database design.
Knowledge of data governance and data quality best practices.
Familiarity with other cloud platforms such as AWS or Google Cloud.
Recent medical claims processing experience.
Data science and analytics experience.
Experience creating algorithms or models with Snowpark, Apache Spark, pandas, NumPy, or Scikit-learn.

Responsibilities

Develop and manage ETL processes for Program Integrity data marts in Snowflake and SQL Server.
Build and maintain Azure Data Factory pipelines for ETL operations, Peer Group Profiling, and data movement between SQL Server and Snowflake.
Test data load processes and create balancing routines to run after each load.
Develop procedures for summarizing data.
Apply DevOps practices to support efficient data loading and workload balancing.
Collaborate with analytics, QA, and other cross-functional teams to ensure accurate data integration and consistent data flow.
Monitor, optimize, and troubleshoot data pipelines and workflows.
Independently identify and resolve complex technical issues.
Communicate effectively and foster collaboration across teams.
Maintain data accuracy and quality through analytical work and attention to detail.
Lead cloud-based project delivery in accordance with timelines, scope, and performance benchmarks.
Ensure data security and compliance with relevant industry standards and regulatory requirements.