Integration Engineer

Scotiabank•Toronto, ON

2d•Onsite

About The Position

Results-driven Integrations Engineer with strong experience in designing, developing, and optimizing data pipelines and database solutions. Skilled in SQL, Azure data services, IBM DataStage, and database development, with a proven ability to build scalable ETL processes, integrate complex data sources, and ensure high data quality and performance. Experienced in developing data models, optimizing queries, and supporting analytics and reporting needs across enterprise environments. Adept at working with large datasets, implementing data governance practices, and collaborating with cross-functional teams to deliver reliable and efficient data solutions.

Requirements

Proven experience as a Data Engineer or similar role. (6+ years)
Strong expertise in SQL (e.g., T-SQL, PL/SQL) for writing and optimizing queries, stored procedures, and data transformations. (6+ years)
Proficient in Azure cloud services, including Azure SQL Database, Azure Data Factory, Azure Key Vault, Azure DevOps / BLOB Storage. (5+ years)
Experience working with large-scale ETL processes and data pipelines. (5 + years)
Knowledge of data modeling and data warehousing (5 + years)
Solid understanding of data security and compliance within cloud environments. (4+ years)
Expertise in IMBs DataStage development (2+ Years)
Familiarity with version control tools such as Git. (5+ years)
Ability to work in a collaborative, fast-paced environment.
Knowledge in Autosys Workload Automation (2+ years)
Bachelor’s degree in Computer Science, Engineering, or related field.
Experience with DevOps practices, CI/CD pipelines, and automation tools.
English with Spanish is a plus.
Strong problem-solving skills and analytical mindset.
Excellent communication and teamwork skills.
Ability to prioritize and manage multiple tasks simultaneously.
Detail-oriented and proactive approach to identifying and resolving issues.

Responsibilities

Design, implement, and optimize robust and scalable data pipelines for extracting, transforming, and loading (ETL) data.
Work with stakeholders to gather requirements and design solutions that align with business goals.
Build and maintain data pipelines using Azure services and SSIS 2019.
Write complex SQL queries for data extraction, aggregation, and transformation.
Develop and optimize stored procedures, views, and functions to support data processing and reporting.
Manage and optimize relational databases and large datasets.
Create ETL solutions using DataStage
Expert in DataStage solution conception design and development.
Build and maintain cloud-based data solutions using Azure technologies such as Azure SQL Managed Instance (SQL-MI), Azure Data Factory and Azure Blob Storage.
Leverage Azure tools for data warehousing and integration.
Optimize data processing and storage costs using Azure resources.
Integrate data from various sources (internal and external) / files and databases to ensure seamless data flow within the organization.
Maintain and monitor the data quality and consistency across all integrated systems.
Collaborate with business stakeholders, analysts, and other engineers to ensure high-quality data infrastructure.
Provide insights and recommendations on how to improve data processing and transformation and distribution.
Continuously monitor the performance of data systems and optimize them for speed, scalability, and cost.
Perform regular database and pipeline performance tuning and troubleshooting.
Continually acquire and enhance knowledge of the Division's business strategies and policies, risk management practices and methodologies, product offerings, financial markets, financial instruments, regulatory requirements, Back Office processes, and rapidly changing technology to be able to provide effective business solutions and services to the end user business lines.
Understand how the Bank’s risk appetite and risk culture should be considered in day-to-day activities and decisions.