Senior Data Engineer
About The Position
We are looking for a Senior Data Engineer to support our Corporate team. This position can work out of our Detroit Lakes, MN, or Plymouth, MN location. As our Senior Data Engineer, you will help establish Data Engineering as a practice at SJE. Using your deep understanding of SQL, enterprise data warehousing, ETL processes, and data integration technologies, you will design and implement reliable integrations between external APIs and Microsoft Fabric. You will analyze source data, create source-to-target field mappings, and build ingestion pipelines that load data into Fabric. You will implement full and incremental data loads using pagination, filtering, watermarks, and change-tracking logic. You will also help administer data elements within our ERP and Salesforce.com and serve as a partner and working member of the Data Analytics team.
Requirements
- Strong hands-on experience with Microsoft Fabric
- A deep understanding of SQL, ETL processes and technologies, enterprise data warehousing, and BI architecture
- Experience designing and implementing full and incremental data loads
- Experience integrating data from relational databases, flat files, web APIs, and other sources
- Experience with Python, Java, or another programming language
- Experience with data warehouse technologies such as Hadoop, Hive, or Spark
- An understanding of software development life cycle models and both Agile and traditional project-management principles
- Excellent problem-solving, analytical, testing, and debugging skills
- Strong written and verbal communication and teamwork skills
- The ability to manage multiple projects and deliverables in a fast-paced environment
- The professionalism and discretion required to protect confidential company, project, financial, and personnel information
- A 4-year degree in Computer Science, Information Technology, Engineering, or a related field
- At least 5 years of experience
Responsibilities
- Identify and map source data in commercial and custom systems
- Design, develop, test, troubleshoot, and maintain complex ETL pipelines
- Extract, transform, and load data from relational databases, flat files, web APIs, and other data sources
- Work with data engineers, analysts, business systems analysts, and other stakeholders to define and document data requirements
- Develop test cases and demonstrate results for assigned deliverables
- Provide development estimates, including tasks, effort, and dependencies
- Help maintain data integrity, system security, and information-system performance
- Partner with business systems analysts to develop dashboards within the company’s ERP system, including IFS Lobbies
- Support the acquisition and integration of acquired companies, systems, and data
- Establish standards for gathering and using information in trend analysis and management reporting
- Provide technical leadership, share best practices, and mentor junior ETL developers
- Communicate project activities, deliverables, risks, and status to team members and stakeholders
- Stay current on data engineering and ETL technologies and best practices
Benefits
- Up to 120 hours of Paid Time Off in your first year
- Eight paid holidays
- Health insurance
- Life insurance
- Short-term disability insurance
- Long-term disability insurance
- Dental insurance
- Vision insurance
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
