RQ11301 - Software Developer - ETL - Senior

Maarut•Toronto, ON

About The Position

This role involves designing, implementing, and continuously expanding data pipelines through extraction, transformation, and loading (ETL) activities. The developer will translate technical system specifications into functional, tested applications, including writing detailed programming specifications, code generation, compiling data-driven programs, and conducting unit tests. Responsibilities also include resolving and troubleshooting technical problems that arise during software operation, providing technical assistance for implementation, conversion, and migration projects.

Requirements

Extensive experience in gathering requirements and business process knowledge in order to design correct and high-quality data transformation.
Extensive experience in design, development, and implementation with Azure Data Factory, Databricks, including: Self-Hosted Integration Runtime, Data movement, ETL pipelines, Performance tuning on large data volumes, Complex data transformations, ADF Debugger to validate data transformation, Azure Roles.
Experience with Informatica, including: Workflow Manager, Repository Manager, Designer, Workflow Monitor.
Experience with developing solutions using Logic App and Function App.
Experience in rapid application development (RAD) methodologies.
Experience in maintaining and improving existing ETL processes.
Experience in investigating data to identify potential issues within ETL pipelines.
Experience with Business Intelligence tools IBM Cognos and Microsoft PowerBI.
Experience with CI/CD (DevOps) pipelines and concepts, including: Azure Resource Management, GitHub Repo, Source code version control, Branching, pull requests, build, release, multiple parallel development repositories merge.
Experience with Azure DevOps, including: Azure Boards, Azure Test Plans, Azure Pipelines, Azure Repos, Azure Artefacts.
Extensive experience in designing and developing SQL Server Stored Procedure, Oracle PL/SQL programs.
Experience with Oracle, Microsoft SQL Server database and tools.
Experience with relational and hierarchical database technologies.
Extensive knowledge of Azure SQL DB and Synapse platforms, including: Performance tuning on large data volume.
Experience in programming and analysis; specialized software package support at the specified experience level.
Ability to collaborate with IT Professionals throughout the Software Development Life Cycle.
Experience in structured methodologies for the development, design, implementation and maintenance of applications.
Experience in design, code, test, debug and document applications.
Experience in the use of object and/or third generation language development tools.
Experience in one or more programming languages.
Experience in application design, latest design patterns, deployment and troubleshooting.
Experience with relational and hierarchical database technologies.
Experience in the use of information retrieval packages using query languages.
Experience with one or more communications protocols.
Experience eliciting and documenting information from diverse business area stakeholders and subject matter experts.
Excellent analytical, problem-solving and decision-making skills; verbal and written communication skills; interpersonal and negotiation skills.
A team player with a track record for meeting deadlines.

Nice To Haves

Knowledge and experience with programming Internet-ready applications.
Knowledge and experience in rapid application development (RAD) methodologies.
Knowledge and understanding of Information Management principles, concepts, policies and practices.
Experience with middleware and gateways.
Experience reviewing, analyzing, and modifying product installation scripts including encoding, testing, debugging.
Ability to provide post-implementation support and resolve any post-implementation technical issues.
Experience conducting design walkthrough sessions with project team.
Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards.
Ability to provide user and system documentation as required.

Responsibilities

Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.
Translate technical systems specifications into working, tested applications.
Develop detailed programming specifications, write and/or generate code, compile data-driven programs, maintain, and conduct unit tests.
Resolve and troubleshoot technical problems which arise during the use and operation of software packages, including technical assistance in implementation, conversion and migrations.
Gather requirements and business process knowledge to transform data according to end-user needs.
Maintain and improve existing processes.
Ensure data architecture is scalable and maintainable.
Work with the business to design and deliver correct, high-quality data.
Investigate data to identify potential issues within ETL pipelines, notify end-users, and propose adequate solutions.
Prepare detailed documentation for further reference.