Data Engineer

Canadian Cancer Society•St. John's, NL

5d•CA$83,000 - CA$93,000•Hybrid

About The Position

The Canadian Cancer Society works tirelessly to save lives, improve lives and drive collective action against cancer. Together, with patients, volunteers, donors and communities across the country, we raise funds to invest in transformative cancer research, we provide a caring support system for everyone affected by cancer and we advocate to governments to create a healthier future for all. It takes a society to take on cancer – and the Canadian Cancer Society is leading the way. Join an exceptional team of Digital Strategy & Technology professionals helping to power the Canadian Cancer Society’s (CCS) operations and fuel our mission through innovative digital solutions. The Digital Strategy & Technology team is at the forefront of CCS’s digital transformation. Together, they are harnessing digital tools, data, and technology to boost fundraising capabilities and enhance the experience of everyone who interacts with us online. With a passion for continuous improvement and a commitment to making an impact, the team ensures CCS’s digital presence is strategic and engaging, helping us inspire and empower more Canadians who care about cancer every day.

Requirements

Bachelor’s or Master’s degree in computer science, information Systems, Data Engineering or related disciplines
3-5 years – similar or related general experience in progressively more senior positions
Strong proficiency in Microsoft Fabric platform components (Data Pipelines, Notebooks, Lakehouse, OneLake)
Expertise in Apache Spark, data pipelines and data transformation frameworks
Knowledge of data architecture and data modeling (Delta Lake architecture, Lakehouse design patterns, and medallion design pattern)
Expertise in SQL for data querying, transformation, and pipeline development
Proficiency in Python for data engineering, automation, and pipeline development
Experience with software engineering for cloud platforms (Python, serverless)
Experience with system integrations, APIs, and data pipelines across cloud and enterprise systems
Experience working with CRM platform data and services (Salesforce preferred)
Familiarity with DevOps practices including CI/CD pipelines, version control, and automation frameworks
Experience implementing monitoring, logging, and alerting practices to ensure reliability and performance of data pipelines and services
Commitment to engineering best practices including code quality, testing, documentation, and continuous improvement of data workflows
Experience with scripting languages for automation and operational tasks
Experience developing and maintaining automated testing frameworks for data pipelines and solutions
Demonstrated ability to align technical deliverables with organizational strategy and business goals
Strong troubleshooting, performance optimization, and problem-solving skills
Strong verbal and written communication skills
Ability to coordinate with technical and non-technical stakeholders effectively
Thrives in a fast-paced, dynamic environments with shifting priorities

Nice To Haves

Relevant certifications preferred (e.g., Microsoft Certified Frabric Analytics Engineer Associate, DP-203 Azure Data Engineer Associate)
Others may apply
Bilingualism (French/English) is highly preferred, with French being an asset due to the organization’s nationwide operations and the need for effective communication across various regions.

Responsibilities

Design, implement, and optimize data ingestion and transformation processes using Microsoft Fabric (Data Pipelines, Dataflows, and Notebooks)
Develop end-to-end ETL/ELT workflows for structured and unstructured data
Automate and orchestrate data workflows for efficiency and reliability
Implement Data Lakehouse architecture leveraging modern data standards
Design and optimize data models using medallion architecture
Optimize storage and processing solutions for performance and cost-effectiveness
Develop data transformations using Apache Spark in Fabric Notebooks for cleansing, aggregation, and enrichment
Optimize Spark workloads, queries, and configurations for performance tuning
Support legacy data platforms and integration processes as required
Build reusable, high-quality datasets and data assets for reporting and insights
Develop and maintain data integrations with Azure data services, external systems, and reporting platforms
Implement data ingestion processes across batch and real-time workflows
Develop transformation framework to support data movement and processing across systems
Automate data workflows and integration processes to improve efficiency and reliability
Coordinate with business and technical teams to translate integration requirements into scalable data solutions
Support data consistency and relationships across systems through integration and data processing workflows
Develop and maintain integration documentation, including data mappings and data models
Develop and maintain CI/CD pipelines using Azure DevOps for data platform solutions
Support source control, branching strategies, and automated deployment processes
Contribute to infrastructure as code, orchestration, and deployment of data pipelines and services
Implement monitoring, logging, and alerting for data pipelines and integrations
Support performance optimization and operational reliability of data solutions
Support data lifecycle processes including archiving, backup, and replication across key platforms
Participate in Agile development processes, including sprint planning and iterative delivery
Apply data governance, compliance, and data quality standards when developing and delivering data pipelines and integrations
Support lineage and metadata management using tools such as Microsoft Purview
Implement and support data security controls aligned with organizational compliance standards
Perform data quality validation and monitoring across data pipelines and datasets
Support adherence to established data policies, standards, and best practices
Contribute to our culture of diversity, inclusion, belonging and equity (DIBE) by ensuring that all staff feel represented, valued, and heard across all aspects of their identity, including gender, age, religion, ethnicity, nationality, race, and sexuality.
Other duties as assigned