Data Engineer II - ETL Pipeline

TD•Toronto, ON

1d•CA$81,600 - CA$115,200•Onsite

About The Position

The Data Engineer is part of the CPB Data Product Family Team within Data as a Service. This role is responsible for working with internal and external technology partners to design and develop advanced data pipeline solutions to provide support to Analytic Developers. We are looking for an energetic data engineer, who can drive Data Projects into completion.

Requirements

Minimum 10 years of Data warehousing experience
At least 3 years on MS Azure Data Lake Ingestion and Curation processes.
Azure skills is required, including provisioning, Configuring, and Developing solutions in Azure Data Bricks, Azure Data Factory, Python.

Nice To Haves

Hands-on experience using MS SQL Server or similar RDBMS platform.
Continuous Integration and Continuous Development where Code Deployment using DevOps tools (Git Hub, Jenkins, Azure Pipelines).
Familiarity with data visualization tools (e.g., PowerBI, Tableau etc.)

Responsibilities

Lead proof-of-concept solutions and prototyping for new patterns based on defined requirements and overseeing solution implementation
Help improve data management processes - acquiring, transforming and storing massive volumes of structured and unstructured data
Ensure compliance with internal and external data privacy standards and regulation.
Lead developing new solutions for batch and real-time data and analytics use cases
Ensure ETL pipelines are produced with the highest quality standards, metadata and validated for completeness and accuracy
Coordinate stakeholders and business partners to ensure successful design and development
Data preparation and transformation using MS Azure Tools
Develop automation and monitoring of services in Analytics platform
Manage project workload and ensure the development standards are respected
Update assigned tasks in sprint management system (JIRA) and provide updates in line with agile methodologies.
Provide on-going communications on project status and systems restrictions.
Oversee code review and ensure high quality work to maintain standards within own area of responsibility
Participate in project committees as necessary to provide guidance and support on Enterprise Data & Analytics technology and act as a key contact for specific business processes, projects or procedures
Provide L3 Production Support as developer of the solution