Databricks Platform Engineer

BrokerLink • Edmonton, AB

2d • Hybrid

About The Position

We are seeking a skilled and proactive Databricks Platform Engineer to join our team. The ideal candidate will be responsible for owning, managing, optimizing, and supporting our Databricks platform end-to-end, including Azure-based deployments and supporting infrastructure-as-code and CI/CD practices. Experience with cloud networking and integration with downstream analytics tooling (including Power BI) is essential to ensure the reliability, security, and performance of our big data and analytics infrastructure.

Requirements

• Bachelor’s degree in Computer Science, Information Technology, or a related field (or equivalent experience).
• Proven experience administering Azure Databricks (or cross-cloud equivalent), including workspace setup, cluster management, and performance tuning.
• Solid understanding of Azure cloud services (e.g., Azure Data Lake, Azure Synapse Analytics, Entra, Azure DevOps).
• Proficiency with Infrastructure as Code using Terraform (preferred), and experience working with CI/CD pipelines to deploy and manage cloud resources.
• Working knowledge of cloud infrastructure concepts—storage, networking, and identity and access management (IAM)—including applied experience with VNets/subnets and Private Link (or cross-cloud equivalents).
• Experience integrating and managing SaaS products within a cloud-based data ecosystem.
• Strong scripting and automation skills (Python and/or Bash).
• Knowledge of big data concepts, Spark architecture, and ETL processes.
• Familiarity with data security, compliance, and governance best practices.
• Agility, innovation, responsiveness and a continuous improvement mindset through proactive problem-solving and ownership of outcomes.
• Able to effectively manage competing demands, rapidly shifting priorities, and high-pressure moments.

Nice To Haves

• Relevant certifications (e.g., Azure Administrator, Databricks Certified Associate) are a plus.

Responsibilities

• Administer, configure, and maintain Azure Databricks workspaces, including user management, cluster setup, resource allocation, provisioning cloud services, and backup and recovery strategy.
• Own and evolve platform automation, including Infrastructure as Code (Terraform) and Azure DevOps CI/CD pipelines for Databricks and dependent cloud resources.
• Monitor system performance and troubleshoot issues related to Databricks clusters, jobs, and data pipelines.
• Implement best practices for security, compliance, and cost management within Azure Databricks environments.
• Collaborate with data engineers, data scientists, and other stakeholders to support their workflows and optimize platform usage, including Power BI and dashboard administration.
• Partner with cloud networking and security teams to design and operate secure connectivity patterns (VNets/subnets, routing/DNS, Private Link, VNet injection), especially for environments isolated from the public internet.
• Integrate Databricks with various SaaS products and services, ensuring seamless data flow and interoperability.
• Administer and maintain Power BI workspaces, datasets, and reports, ensuring effective data visualization and reporting capabilities.
• Automate routine administrative tasks using scripting (Python and/or Bash) and Databricks REST APIs.
• Manage data access controls, auditing, and monitoring to maintain data integrity and privacy.
• Stay current with new features, updates, and best practices in Databricks, Azure, and relevant SaaS platforms.
• Document procedures, configurations, and troubleshooting steps for internal knowledge sharing.

Benefits

• Flexible work arrangements
• Multiple benefits offered to support physical and mental wellbeing
• Wellness account
• Share plan & other savings
• Incentive plan
• Annual bonus
• Employee Share Purchase Plan (ESPP) – with BrokerLink matching a portion of your contributions
• Group RRSP, with company matching DPSP offerings

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 501-1,000 employees