Data Engineer II

TD•Toronto, ON

11d•CA$81,600 - CA$115,200•Onsite

About The Position

TD is seeking a Data Engineer II to join their Technology Solutions team in Toronto, Ontario, Canada. This role involves performing complex data analysis, managing data requirements for specific platforms or journeys, and maintaining expert knowledge of upstream data. The Data Engineer will support data acquisition and ingestion, articulate technical details to non-technical partners, and develop complete business solutions including data models, ETL processes, and data lifecycle management. Ensuring data compliance with enterprise standards, developing complex data models and ETL jobs, and providing support to development and testing teams are key responsibilities. The role also requires building effective working relationships, coordinating with various technology teams, supporting QA with data investigations, and overseeing post-implementation activities. Additionally, the Data Engineer will be involved in code management, deployment processes, design and architecture reviews, and managing release activities. A significant aspect of the role includes leading data engineering initiatives, ensuring metadata and data lineage capture, adhering to security coding practices, managing risks, and staying current with emerging trends. The position also emphasizes enabling team members through knowledge sharing and mentoring, contributing to a positive and collaborative work environment, and acting as a brand ambassador.

Requirements

Advanced knowledge of data engineering frameworks, technologies, tools, processes, patterns, and procedures, including how they impact other technology areas such as Architecture or Infrastructure
Performs complex technical tasks independently
Advanced knowledge of TD applications, systems, networks, innovation, design activities, business, organization, best practices, and standards
Designs and develops to meet business and technical requirements; analyzes, adapts, integrates, codes, tests, debugs, and executes
Uses and evolves established patterns to solve complex problems; leads the development of new patterns where necessary
May be recognized as a subject matter expert in areas directly related to key accountabilities
Degree, Postgraduate Degree, or Technical Certificate in Data Management or related discipline (e.g. Computer Science, Engineering), or equivalent practical experience
A minimum of 3 years' relevant experience
Working experience in Microsoft Azure, Databricks, Pyspark, Python, SQL, ADF
Measurable outcomes from having leveraged AI to improve productivity.
Excellent at problem-solving, communication and at influencing stakeholders.

Responsibilities

Perform data analysis and assess data management requirements for a specific Platform or Journey, including complex analysis involving multiple pods or products
Maintain expert knowledge of upstream data, including knowledge provided through data profiling, data quality reporting, and via the production of metadata
Support the acquisition and ingestion of data
Articulate complex, large scale, and high impact technical design and development details to non-technical business partners
Elicit, analyze, and understand business and data requirements to develop complete business solutions, including data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life-cycle management, governance, lineage, and metadata
Ensure data is maintained in compliance with enterprise data standards, policies, and guidelines
Develop and maintain complex data models using industry standard modeling tools
Develop and maintain complex ETL jobs and frameworks using the Bank's standard tools
Provide support to the development and testing teams to resolve data issues, including escalation support on complex issues
Support partners and stakeholders in interpreting and analyzing data
Build effective working relationships within own pod and across partner teams to encourage collaboration on all pod deliverables
Coordinate with technology work teams such as ITS, ARE, Architecture, Enterprise Protect etc. to ensure overall delivery success
Support the QA team with data analysis/investigations of complex issues/ test cases as part of SIT/UAT/PAT testing
Provide oversight on post implementation activities during the warranty period
Execute & approve code check-in/ check-out into source code repository as part of source code management
Work closely with ITS/ ARE teams to support code packaging & deployment (CI & CD) into higher environments
Be the lead participant in the design & architecture reviews or the application
Raise service-now requests and work with the change management team to support release management activities
Lead data engineering initiatives and capabilities, data governance principles and how they apply across the organization
Ensure metadata and data lineage is captured and compatible with enterprise metadata and data management tools and processes
Adhere & contribute towards standard security coding practices to ensure application is free of most common coding vulnerabilities
Ensure technical decisions, technical risks and lessons learned are identified, clearly documented and enhancements are accordingly implemented
Protect the interests of the organization – identify and manage risks, and escalate non-standard, high-risk activities as necessary
Adhere to internal policies/procedures and applicable regulatory guidelines
Keep current on emerging trends/ developments and grow knowledge of the business, related tools, and techniques
Enable team members by sharing knowledge and leveraging engineering best practices.
Participate fully as a member of the team, support a positive work environment that promotes service to the business, quality, innovation and teamwork and ensure timely communication of issues/ points of interest
Provide thought leadership and/ or industry knowledge for Data engineering best practices and participate in knowledge transfer within the team and business unit
Keep current on emerging trends/ developments and grow knowledge of the business, related tools and techniques
Participate in personal performance management and development activities, including cross training within own team
Keep others informed and up-to-date about the status / progress of projects and / or all relevant or useful information related to day-to-day activities
Actively mentors and enables team members by sharing knowledge and leveraging engineering best practices.
Supports the team by providing guidance and proactively identifying and resolving issues
Lead, motivate and develop relationships with internal and external business partners / stakeholders to develop productive working relationships.
Contribute to a fair, positive and equitable environment that supports a diverse workforce
Act as a brand ambassador for your business area/function and the bank, both internally and/or externally