Data Engineer II

TD•Toronto, ON

2d•Onsite

About The Position

The Treasury Analytics Group is responsible for measurement and management of market risk (interest rate and foreign exchange) for the Bank's retail portfolios. The team develops financial models and processes required for measuring, transfer pricing, hedging product profitability, and financial management reporting. We are seeking a skilled Cloud Engineer with expertise in Spring Boot, Data Lakehouse architectures and Spark Databricks. This ideal candidate will have strong scripting skills and experience working in cloud environments. You will play a key role designing, developing, and optimizing cloud-based applications while ensuring scalability, security, and performance.

Requirements

Degree, Postgraduate Degree, or Technical Certificate in Data Management or related discipline (e.g. Computer Science, Engineering), or equivalent practical experience.
5 Years of experience with Spring Boot
Hands-on experience working with Data Lakehouse architectures.
Expertise in Spark Databricks for big data processing
Strong proficiency in Python scripting
Proficiency In scripting with Linux or PowerShell scripting

Nice To Haves

Experience with Azure SQL and ASE
Knowledge on Event Hub, HashiCorp Vault or equivalent
Experience with Azure Functions for serverless computing.
Familiar with observability tools like Datadog
Experience with Autosys for jobs scheduling.

Responsibilities

Design, Develop and deploy Cloud based applications using Spring Boot
Work with Data Lakehouse architectures to optimize data processing and storage.
Implement and manage Spark Databricks pipelines for data processing.
Develop and maintain scripts using Linux or PowerShell for automation and system management.
Collaborate with cross-functional teams to integrate cloud solutions.
Strong understanding of Python syntax, data types, control structures, functions, and error handling