About the position
Shift4 is expanding globally and building out our data engineering team, seeking an experienced Director of Data Engineering with a minimum of 10 years of overall experience, 3 years of management to spearhead our data architecture, pipeline development, and data lake / data warehousing efforts. This role involves not just technical expertise but also leadership in guiding data strategies that empower our business decisions and initiatives.
Responsibilities
- Design, implement, and manage our data infrastructure, ensuring scalability, efficiency, and security.
- Lead a team of ~10 data engineers, setting standards for data handling, integration, and warehousing.
- Mentor junior team members, fostering a culture of continuous learning and improvement.
- Develop robust ETL (Extract, Transform, Load) processes to ingest, process, and transform data from various sources.
- Optimize data flow and storage for speed, scalability, and reliability.
- Establish and enforce data quality standards and governance policies.
- Implement data validation processes to ensure data integrity.
- Collaborate with data scientists and analysts to tailor data solutions that meet analytical requirements.
- Support the creation of BI tools, dashboards, and reports by providing clean, structured data.
- Research and recommend new technologies and tools to improve data management and processing.
- Drive the adoption of best practices in data engineering, like data lake architectures, streaming data, and real-time analytics.
- Oversee data-related projects from conception to completion, including planning, execution, and delivery.
- Ensure project timelines, quality, and objectives are met.
- Work closely with business stakeholders, product managers, and other engineering teams to align data strategy with business goals.
Requirements
- Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or related field or experience in lieu of a degree may be considered.
- At least 10 years of experience in data engineering or a similar discipline.
- At least 3 years of experience in managing data engineers or a similar discipline.
- Experienced conducting 1:1s, fostering growth plans, and managing engineering velocity.
- Proficiency in SQL and experience with big data technologies (e.g., Hadoop, Spark).
- Strong coding skills in languages like Python, Java, Scala, Node JS, Golang, etc.
- Experience with cloud services (AWS, Azure, Google Cloud) for data solutions.
- Knowledge of data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
- Familiarity with data modeling, ETL tools, and data pipeline orchestration tools (e.g., Airflow, Luigi).
- Understanding of machine learning pipelines and feature engineering is a plus.
- Excellent analytical and problem-solving skills.
- Strong communication skills to effectively articulate complex data concepts to non-technical stakeholders.
Nice-to-haves
- AWS Certified Big Data - Specialty
- Google Professional Data Engineer
- Similar certifications.
