Data Engineer- Hybrid Onsite Des Moines, Iowa
About The Position
Wellabe is looking for a Date Engineer to join our team. The Data Engineer will implement and optimize ETL processes to ensure data accuracy, consistency, and scalability. They will support the buildout, migration, and maintenance of the company’s Enterprise Data Lake house. The role involves working with senior engineers to design and develop data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems. The Data Engineer will also work closely with Information Technology teams to implement continuous integration and deployment (CI/CD) pipelines using Azure DevOps. Additionally, they will assist in administering and optimizing Azure Databricks clusters and ensure efficient data processing. Collaboration with analysts and business units to design and implement efficient data models is key. The role also includes determining data tracking and storage needs, performing data auditing and validation, data mapping, loading and conversion planning, and resolving data issues or discrepancies.
Requirements
- Bachelor’s degree or foreign equivalent in Data Science, Computer Science, Data Analytics, Management Information Systems, or related field
- 3 years of experience in Data engineering and/or data architecture
- 3 years of experience with SQL
- 3 years of experience with Python, PySpark, or Bash
- 3 years of experience with Azure DevOps for CI/CD
- 3 years of experience with version control such as Git, GitHub, or Azure DevOps
- 3 years of experience developing ETL pipelines
- 3 years of experience working in data management and transformation processes
- 3 years of experience with Azure Databricks
- 3 years of experience using advanced performance tuning
- 3 years of experience with data validation
- 3 years of experience with Apache Spark and Delta Lake.
- 2 years of experience with Cluster management
- Must work in Des Moines, IA office with the option to work from home a few days per week
Responsibilities
- Implement and optimize ETL process to ensure data accuracy, consistency, and scalability.
- Support the buildout, migration, and maintenance of the company’s Enterprise Data Lake house.
- Design and develop data pipelines that extract data from various sources, transform it into the desired format, and load it into the appropriate data storage systems.
- Implement continuous integration and deployment (CI/CD) pipelines using Azure DevOps.
- Administer and optimize Azure Databricks clusters and ensure efficient data processing.
- Design and implement efficient data models.
- Determine data tracking and storage needs.
- Perform data auditing and validation.
- Perform data mapping, loading and conversion planning.
- Resolve data issues or discrepancies.
Benefits
- Hybrid availability
- 401(k) with company match
- Health insurance
- Paid time off, holidays
- Volunteer time off
- Lifestyle Spending Account (LSA)
- Paternity leave
- LinkedIn Learning Premium access
- CliftonStrengths® assessment and coaching
- On-site and virtual workshops and cohorts featuring world-class content from FranklinCovey, Crucial Learning, Gallup, and more
- Free world-class insurance acumen courses through AHIP and LOMA
- Reimbursement and bonus opportunities for professional designations and certifications, including a tuition reimbursement program
- Opportunities to take part in Wellabe's mentorship programs
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
