Lead Databricks Consultant

CNX•CAN, ON, Work-at-Home, ON

6d•CA$137,837 - CA$196,910•Remote

About The Position

Lead Databricks Consultant - Strategic Solution Architecture. This role involves presales and solutioning, partnering with sales and account teams to understand customer objectives and identify high-value Databricks use cases. You will shape solution visions and reference architectures for data, analytics, and AI platforms built on Databricks and cloud services (Azure, AWS, or GCP). Responsibilities include developing proposals, statements of work, delivering technical presentations, and addressing technical objections to build confidence with client architects and executives. You will also drive additional revenue by uncovering opportunities to expand business within the current customer base. Additionally, you will lead the design and implementation of secure, scalable Databricks Lakehouse architectures, oversee the build of data pipelines, define and enforce engineering standards, and collaborate with project managers and client stakeholders for successful project delivery. You will provide hands-on technical leadership, implement data governance and security practices, optimize performance and cost, and drive change management and enablement through documentation and training. Support for production go-lives and post-olive stabilization is also required, along with creating plans to engage with and add net new customers.

Requirements

Excellent communication, stakeholder management, and presentation skills, with the ability to influence technical and nontechnical audiences.
Demonstrated ability to run workshops, gather requirements, and translate business needs into technical designs and phased roadmaps.
Proven experience leading client facing data or analytics projects in a consulting, professional services, or similar environment.
Extensive hands-on experience designing and delivering data platforms and pipelines on Databricks, including Delta Lake, Jobs/Workflows, and Databricks SQL.
Strong programming skills in at least two of: Python, PySpark, and SQL, with demonstrated ability to build performant batch and streaming solutions.
Solid understanding of cloud services (Azure, AWS, or GCP) relevant to Databricks deployments, such as storage, networking, identity, and DevOps tooling.
Experience implementing data governance, security, and access control in Lakehouse or data platform environments using Unity Catalog or similar tools.

Nice To Haves

Experience with largescale data platform migrations or modernizations (e.g., from legacy ETL/warehouse tools to Databricks).

Responsibilities

Presales and solutioning: Partner with sales and account teams to run discovery sessions, understand customer objectives, and identify high value Databricks use cases.
Shape solution visions and reference architectures for data, analytics, and AI platforms built on Databricks and cloud services (Azure, AWS, or GCP).
Develop proposals and statements of work, including scope, phases, estimates, risks, and assumptions for Databricks engagements.
Deliver technical presentations, whiteboard sessions, and demos that clearly communicate Databricks capabilities and business value to diverse audiences.
Address technical objections, guide architecture discussions, and build confidence with client architects and executives during the sales cycle.
Drive additional revenue by proactively uncovering opportunities to expand business within current customer base.
Lead the design and implementation of secure, scalable Databricks Lakehouse architectures, including Delta Lake, Unity Catalog, and integration with upstream and downstream systems.
Pro-actively define offerings, IP and associated collateral that will resonate with both new/existing customers and help close new business.
Oversee the build of batch and streaming data pipelines, notebooks, and Databricks SQL assets using Spark, Python, and SQL, following medallion and other best practice patterns.
Define and enforce engineering standards, including code quality, testing, CI/CD, observability, and operational readiness for Databricks workloads.
Collaborate with project managers and client stakeholders to plan releases, manage dependencies, mitigate risks, and ensure on time, on budget delivery.
Provide hands on technical leadership to data engineers and analysts, reviewing designs and code, and unblocking complex technical issues.
Implement data governance and security practices using Unity Catalog and related tools, including access control, lineage, and compliance aligned policies.
Optimize performance, reliability, and cost of Databricks workloads through cluster tuning, storage strategies, and monitoring.
Drive change management and enablement by creating documentation, runbooks, and training materials, and facilitating knowledge transfer to client teams.
Support production go lives and post olive stabilization, ensuring robust handover to client operations or managed services teams.
Work with specialty sales team and COE Lead to create a plan to engage with and add net new customers to existing portfolio.