AI Native, Data Engineer

ConsumerAffairs

About The Position

The Data Engineer is responsible for monitoring, expanding, and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems as well as building them from the ground up. The Data Engineer supports our solution architects, data analysts, and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. Candidates should have education and/or experience in data modeling, requirements analysis, and best practices in analytics. Experience with BI applications is a definite plus.

Requirements

BSc/BA in Computer Science, Engineering or relevant field
2-4 years of experience in data engineering or a related field.
2-4 years’ experience in Data Integration and Integration
2- 4 years’ experience in Data Warehousing, notably Cloud Data
Proficiency in SQL and Python
Familiarity with cloud platforms (AWS, GCP) and data warehousing solutions.
Understanding of ETL processes and data integration techniques.
Knowledge of SQL is required
Understanding of data models, data warehouses, and data mining
Analytical mind with a problem-solving aptitude
Stands up for decisions and takes responsibility for results
Shares both good and bad outcomes transparently
Obsessed with ensuring an exceptional customer experience- for both internal and external customers.
Stands up for decisions, takes responsibility for results, and shares both good and bad outcomes transparently.
Demonstrates a relentless focus on results with a commitment to deliver;
Takes decisive action, and confidently changes course if unsuccessful.
Displays a growth mindset to continually improve; encourages everyone around them to be tenacious and never settle.
Constantly seeks feedback to improve; Focuses on solving issues through teamwork, and collaboration
Acts with urgency; delivers top results in hours and days instead of weeks and months.
Relentless in their pursuit of success and possessing the willpower to embrace challenges as opportunities

Nice To Haves

experience with ETL tools like Stitch, Fivetran, and Snowfire
Must be highly curious, driven, and disciplined
Familiarity with BI technologies
Familiarity with cloud analytics is beneficial (AWS, Snowflake)
Proven abilities to take initiative and be innovative
Fluent in English

Responsibilities

Develop, test, and maintain data pipelines to support data integration and processing.
Assist in the design and implementation of data models and data warehousing solutions.
Collaborate with data scientists and analysts to understand data requirements and ensure data is accessible and reliable.
Monitor data pipelines and systems, troubleshooting issues as they arise.
Work with senior data engineers to optimize data processes and infrastructure.
Ensure data quality and integrity through regular audits and validations.
Contribute to the documentation of data processes and best practices