Senior Data Engineer

International Dairy Queen•Bloomington, MN

7d•Hybrid

About The Position

We have an exciting opportunity available for a Senior Data Engineer located out of our corporate office in Bloomington, MN. The Sr. Data Engineer works with a team of skilled Analysts on the development and support of the Analytics & Reporting Enterprise Data Warehouse (EDW) and PowerBI reporting environments at Dairy Queen. This position will work closely with our Analytics & Insights team to design, build, and maintain the computational infrastructure to support the business intelligence platform. This position plans, designs, and optimizes for data throughput and query performance issues. This requires constantly updating expertise in areas such as platform, network and storage technologies, bandwidth management, data bus implications, and design. Additionally, this position plays a key role in the configuration and utilization of backend database technology. Drive optimization of the full data pipeline and infrastructure to support the actual content, volume, ETL to support the intended kinds of queries and analysis to match expected responsiveness. The Sr. Data Engineer also includes limited leadership responsibilities, including mentoring junior engineering roles and actively participating in project management for the team. This position requires expertise in Python scripting language and experience in API integration.

Requirements

B.S. or M.S. in computer science, computer engineering, or a related technical field or equivalent relevant experience in lieu of degree
Minimum 7 years of experience in cloud-based ETL architecture/development, implementation and support
Advanced SQL development skills and an in-depth understanding of database technologies
Strong Python and SQL; Spark (DataFrames/Delta); API integration; version control (Git)
Practical expertise with Power BI (dataset modeling, DAX, performance tuning)
ETL Design, automation, and cloud ETL as well as monitoring and alerting.
Minimum of 7 years experience working with Microsoft BI Tools, including Azure Data Lake, Azure Data Lake Analytics, Azure SQL Database, Azure Data Bricks and Azure SQL Data warehouse and Azure Data Factory
Experience with API integration
Experience with Azure cloud infrastructure and distributed computing
Familiarity with large-scale analytics systems
Excellent analytical and problem-solving skills
Strong written and oral communication skills

Responsibilities

Design, architect, and document the database schema and data pipelines
Design, implement, and test data collection, storage, and mapping procedures
Research, design, and test computational environments to support analytical modeling (statistics, machine learning, optimization, and simulation)
Develop statistical models for data quality assurance and data imputation
Collaboratively troubleshoot technical and performance issues within the data platform
Write, optimize, and automate data processing tasks
Deploy and maintain system and database monitoring tools
Handle advanced topics like data governance, security, and compliance
Define best practices and standards for data engineering
Mentor junior engineers and review code
Lead projects or act as a technical lead within the team
Collaborate closely with architects and product owners to align data strategy