The Data Engineer develops, deploys, and supports business functions in relation to data engineering.
Requirements
Bachelor's Degree in Computer Science, Software Engineering, or other related degree required
2+ years prior related experience required
1+ year of experience with large data sets required
Familiarity with Software Design Concepts
Snowflake/ SQL experience required
Programming- (Python/Scala/Java/VB and etc) required, Python preferred
ETL
Cloud Development (Azure/AWS/GCP) Azure preferred
Data Modelling
Software Architecture
Cloud Architecture
PowerBI/Tableau/Domo
Responsibilities
Build and maintain secure and compliant data processing pipelines, tables, views, procedures and datasets
Integrate, transform, and consolidate data from various structured and unstructured data systems into structures that can support analytics, data science, and machine learning
Explore second and third party data sources that can drive value and design smart strategies to acquire and standardize it to support apps and analytics
Monitor, troubleshoot and resolve issues in production environments
Collaborate with analysts and data scientists to create value from data and build the production infrastructure to deliver and act upon those insights at scale
Tune and monitor data pipelines to maximize their performance over time