Data Engineer

InnoSoul • Raleigh, NC

4d • Hybrid

About The Position

DHHS-ITD is seeking a Data Engineer for development and optimization of end-to-end solutions using Microsoft Azure Synapse Analytics and Power BI for the Child Welfare Program. The Department of Health and Human Services (DHHS) requires the assistance of a contract resource to serve as a Data Engineer for the development and optimization of data pipelines, analytics solutions, and cloud-based data platforms. This role will be instrumental in designing and implementing end-to-end data engineering solutions using Microsoft Azure Synapse Analytics to meet child welfare business needs.

Requirements

• Experience in designing and optimizing scalable data pipelines using modern platforms like Azure Synapse, Snowflake or Databricks workflows
• Strong proficiency in Python or Scala for data processing.
• Advanced query writing, performance tuning, and optimization.
• Hands-on experience in developing efficient PL/SQL procedures
• Experience with Programming and Scripting (SQL, T-SQL, and data query optimization)
• Experience with Azure Data Platform (Azure Data Factory, Azure Data Lake, and Azure SQL Database)
• Experience with cloud platforms (e.g. AWS and Azure) and associated services for data processing and storage

Nice To Haves

• Experience with Power BI

Responsibilities

• Design, Develop and maintain data models in Synapse to support reporting and analytics
• Develop ETL solutions using Azure Synapse Analytics Pipelines and dedicated SQL pools for extraction, transformation and aggregation from Salesforce objects.
• Analyze the source system and design the ETL data load.
• Ability to create and configure Azure Synapse Analytics workspace.
• Create pipelines in Azure Synapse using Linked Services/Datasets/Pipeline to Extract, Transform and Load data from different sources like Salesforce.
• Perform needed monitoring, troubleshooting, and maintenance of the data architecture and pipelines.
• Collaborate with data engineers, analysts, and stakeholders to gather requirements, design visualizations, and provide training to use self-service BI Tools.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed