Data Engineer II (Azure Databricks / Azure Data Factory) (US)

TD Bank • Mount Laurel Township, NJ

78d • $81,000 - $139,000 • Hybrid

About The Position

The Data Engineer (Azure Databricks/ Azure Data Factory) II provides a broad range of data engineering functions including data modeling, data quality, data profiling, data acquisition and ingestion, extract transform load (ETL), metadata enrichment and management, data provenance and lineage, and other specialized data management functions. The role requires advanced knowledge of data engineering frameworks, technologies, tools, processes, patterns, and procedures, including how they impact other technology areas such as Architecture or Infrastructure. The Data Engineer will perform complex technical tasks independently and will be recognized as a subject matter expert in areas directly related to key accountabilities.

Requirements

• Degree, Postgraduate Degree, or Technical Certificate in Data Management or related discipline (e.g. Computer Science, Engineering), or equivalent practical experience.
• 3+ years of relevant experience.
• Advanced knowledge of data engineering frameworks, technologies, tools, processes, patterns, and procedures.

Nice To Haves

• Databricks
• Azure
• Python
• PySpark
• ADF
• Data Products
• Banking domain experience

Responsibilities

• Designs and develops to meet business and technical requirements; analyzes, adapts, integrates, codes, tests, debugs, and executes.
• Uses and evolves established patterns to solve complex problems; leads the development of new patterns where necessary.
• Performs data analysis and assesses data management requirements for a specific Platform or Journey.
• Maintains expert knowledge of upstream data, including knowledge provided through data profiling, data quality reporting, and via the production of metadata.
• Supports the acquisition and ingestion of data.
• Articulates complex, large scale, and high impact technical design and development details to non-technical business partners.
• Elicits, analyzes, and understands business and data requirements to develop complete business solutions.
• Ensures data is maintained in compliance with enterprise data standards, policies, and guidelines.
• Develops and maintains complex data models using industry standard modeling tools.
• Develops and maintains complex ETL jobs and frameworks using the Bank's standard tools.
• Provides support to the development and testing teams to resolve data issues.
• Coordinates with technology work teams to ensure overall delivery success.
• Supports the QA team with data analysis/investigations of complex issues/test cases.
• Leads data engineering initiatives and capabilities, data governance principles and how they apply across the organization.
• Ensures metadata and data lineage is captured and compatible with enterprise metadata and data management tools and processes.

Benefits

• Base salary and variable compensation/incentive awards.
• Health and well-being benefits.
• Savings and retirement programs.
• Paid time off (including Vacation PTO, Flex PTO, and Holiday PTO).
• Banking benefits and discounts.
• Career development and reward and recognition programs.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: Credit Intermediation and Related Activities
• Education Level: Bachelor's degree