Manager, Data Engineering
About The Position
We are looking for a Data Engineering Manager to oversee a small technical team to drive forward development of a Health oriented data warehouse. The role will oversee numerous projects and initiatives across the complete data lifecycle, including: data governance, ETL processes, data validation, standardization and normalization, data integrity/QA/QC, integrations between datasets, and reporting and dashboards. This person will need to operate at both a technical and a business level, helping to delineate roles and responsibilities across the data team, with a focus on minimizing frictions while creating high quality, reliable technical products in line with business needs and expectations. This role relies on strong collaboration between internal teams including data engineering, operations, analytics, IT, and other stakeholders, as well as external data vendors and content producers. Proactive communication and strong project management skills will be a must in this role.
Requirements
- Bachelor's degree in computer science, mathematics, or related field; MBA or equivalent work experience desired
- Proficiency in SQL and Python, with hands-on industry experience is a must
- Experience in conducting code review a must; familiarity with unit, integration, and functional testing best practices and procedures a strong plus
- Strong project management skills a must; familiarity with Agile methodology a strong plus
- Experience with GitHub is a must; experience with Azure DevOps a strong plus
- Experience in overseeing multi-disciplinary teams in a data-oriented capacity a must
- Experience in building and maintaining data pipelines and data stores
- Experience in extracting maximum value from low quality and/or error ridden input data a strong plus
- Strong communication and client-facing skills with the ability to work in a centralized technology environment
Nice To Haves
- MBA or equivalent work experience desired
- familiarity with unit, integration, and functional testing best practices and procedures a strong plus
- familiarity with Agile methodology a strong plus
- experience with Azure DevOps a strong plus
- Experience in extracting maximum value from low quality and/or error ridden input data a strong plus
Responsibilities
- Oversee the data engineering team through leadership and supervision. Staff will include data engineers and ETL specialists
- Technical ownership of data warehouse, including system and data architecture, engineering and data pipelines
- Lead collaboration for deployment and implementation of tools necessary to integrate data within and across information systems and their use for decision-making
- Understand business requirements and how they translate in application features.
- Develop and implement methods to improve data reliability and quality
- Maintain data governance and documentation practices for a variety of data inputs from a number of sources, including flat files and spreadsheet-like files transmitted through SFTP, as well as JSON/XML style objects from API interfaces, among others
- Participate in the evaluation/pilot of new technologies and provide recommendations on how they support business need
- Manage and communicate with data platform stakeholders balancing business needs with technology capabilities
- Develop testing protocols to ensure processes are robust and bugs are identified and corrected
- Conduct functional and non-functional testing
- Evaluate existing data models and pipelines to update and add new features
- Develop technical documentation to accurately represent data models
- Ensure that integration processes are fully tested and any issues/limitations in integrations are well defined and documented
- Work with cross functional technology and business partners to lead the technical delivery of integration solutions approved within the portfolio and contribute to the development of the Funds' data strategy
- Collaborate with business partners and internal teams to understand, document and prioritize new datasets and features to be added to the data warehouse.
- Align closely with agency IT teams to support the deployment of integration systems.
- Partner with the QA and Infrastructure teams to ensure compliance with regulatory and security requirements.
- Collaborate with Data Warehouse Architect in the design for the overall architecture of the data platforms and provide guidance and oversight
- Ensure that guiding principles and technology and privacy standards are followed.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Manager
