EA DT Engineer
About The Position
Design, develop, and deliver large-scale data systems, data processing, and data transformation pipelines. Collaborate with stakeholders to understand business needs and deliver reliable, flexible, scalable, enterprise-grade datasets with low cost of ownership. Develop optimized, scalable batch integration solutions, including traditional data warehouse workloads and scheduled nightly large extracts. Extract data from various sources, transform it, and load it into Azure Data Lake using Azure Data Factory (ADF) pipelines, Databricks, PySpark, and SQL. Design star-schema and snowflake data models; understand analytical models such as Kimball; and build physical data models aligned with best practices and requirements. Plan, review, and implement database changes for integration and data warehouse work. Work with the BI team and product owner to build required tables and transform data for loading into Snowflake or Dremio. Perform data management tasks and recommend improvements to data reliability, efficiency, and quality. The position is based at ABC Supply’s Beloit, Wisconsin office and requires onsite work five days per week.
Requirements
- Master’s degree in Computer Science, IT/IS, or a related field and two years of work experience in the job offered or a related occupation; alternatively, a bachelor’s degree in one of these fields and five years of such experience.
- Demonstrated experience with enterprise integration patterns (EIP), data warehouse modeling, ETL processes, and database management.
- Demonstrated experience with development and data warehouse requirements gathering, analysis, and design.
- Demonstrated experience with cloud-native modern data engineering projects.
- Demonstrated experience designing, building, and deploying scalable data pipelines.
- Demonstrated experience with Python, PySpark, and Spark SQL.
- Demonstrated experience with analytical data models such as Kimball.
Responsibilities
- Design, develop, and deliver large-scale data systems, data processing, and data transformation pipelines.
- Collaborate with stakeholders to understand business needs and deliver reliable, flexible, scalable enterprise datasets with low cost of ownership.
- Develop optimized, scalable batch integration solutions, including data warehouse workloads and scheduled nightly large extracts.
- Extract data from multiple sources, transform it, and load it into Azure Data Lake using ADF pipelines, Databricks, PySpark, and SQL.
- Design star-schema and snowflake data models and build physical data models aligned with best practices and requirements.
- Plan, review, and implement database changes for integration and data warehouse work.
- Work with the BI team and product owner to build required tables and transform data for loading into Snowflake or Dremio.
- Perform data management tasks.
- Recommend ways to improve data reliability, efficiency, and quality.
Benefits
- Health coverage, eligible after 60 days
- Dental coverage, eligible after 60 days
- Vision coverage, eligible after 60 days
- 401(k) with generous company match, eligible after 60 days and immediately vested
- Employer-paid employee assistance program
- Employer-paid short-term and long-term disability
- Employer-paid life insurance
- Flexible spending
- Paid vacation
- Paid sick days
- Paid holidays
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
