Data Engineering Lead
About The Position
The Data Engineering Lead builds and operationalizes the data needed for enterprise data and analytics initiatives using industry-standard practices and tools. The role leads the development, management, optimization, and production deployment of data pipelines for analysts, data scientists, and other enterprise data consumers. It also tests data quality to ensure data conforms to business rules and is accurate, complete, consistent, and uniform. The position provides technical leadership while developing team members. It works with data science, business analysis, and data governance teams to refine data requirements, support data consumption, train colleagues in data preparation and pipelining, and promote suitable content into a governed data catalog. The role also helps modernize data management infrastructure, supports automation, communicates complex results to varied audiences, and works with stakeholders to ensure services meet business needs.
Requirements
- Bachelor's degree in computer science, statistics, a related field, or relevant work experience.
- 7+ years of related experience in data management disciplines, including data integration, modeling, optimization, and data quality, or other areas directly relevant to data engineering responsibilities and tasks.
- 7+ years of experience with database programming languages and advanced analytics.
Nice To Haves
- Master's degree in computer science, statistics, or a related field.
- Hands-on data testing experience.
- Demonstrated success working with data preparation tools.
- Extensive experience with data engineering tooling, such as Glue, Landa, Athena, and AWS.
- Expert knowledge of BI software tools.
- Expert experience with open-source and commercial data science platforms.
- Learn and/or Agile methodology.
- Strong experience with data management architectures and processes.
- Strong ability to design, build, and manage data pipelines.
- Strong experience working with large, heterogeneous datasets to build and optimize data pipelines, pipeline architectures, and integrated datasets.
- Demonstrated success using large, heterogeneous datasets to extract business value.
- Strong experience with DevOps capabilities such as version control, automated builds, testing, and release management.
- Ability to communicate complex results to technical and non-technical audiences.
- Ability to work effectively in teams and independently across multiple tasks while meeting aggressive timelines.
- Strategic, intellectually curious thinker with a focus on outcomes.
- Professional image and ability to form relationships across functions.
- Ability to train more junior analysts regarding day-to-day activities, as necessary.
- Proven ability to lead cross-functional teams.
- Willingness and ability to learn new technologies on the job.
- Financial services background.
Responsibilities
- Architect, create, maintain, manage, and optimize data pipelines, and move them into production.
- Assist with renovating data management infrastructure to drive automation in data integration and management.
- Partner with data science teams and business analysts to refine data and data-consumption requirements for data and analytics initiatives.
- Train counterparts across the organization in data pipelining and preparation techniques.
- Work with data governance teams and participate in vetting and promoting business- and data-science-created content to the curated data catalog for governed reuse.
- Test data quality to ensure data conforms to business rules and is accurate, complete, consistent, and uniform.
- Communicate complex results to technical and non-technical audiences.
- Provide leadership, coaching, and mentoring to team members and develop the team to work with all areas of the organization.
- Work with stakeholders to understand business needs and ensure services meet those needs.
- Anticipate and analyze technology trends and assess the impact of emerging technologies.
- Coach individuals through change and serve as a role model.
- Perform other duties as assigned.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
