Sr Databricks Data Engineer

Deloitte•Tampa, FL

88d•$116,200 - $229,100•Hybrid

About The Position

Join Deloitte’s AI & Engineering practice and help organizations transform enterprise technology platforms, modernize data environments, and unlock value through innovation. As a Databricks Engineer in our AI & Data practice, you will design, build, and optimize cloud-based data engineering solutions that support large-scale transformation. You will work with business and technology leaders to modernize data platforms, enable analytics and artificial intelligence use cases, and drive measurable business outcomes. This role offers the opportunity to deliver enterprise-scale Databricks solutions that improve performance, expand digital capabilities, and help clients scale data-driven decision-making across the enterprise.

Requirements

Ability to work independently and collaborate as part of a team
Effective written and verbal communication skills
Meticulous attention to detail and quality of work product
Ability to build and sustain professional relationships
Ability to lead projects or workstreams
Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
Strong interpersonal skills and professional demeanor
Ability to meet deadlines
Bachelor’s degree in Computer Science, Engineering, or a related field
5+ years of hands-on experience in data engineering with a focus on Databricks on Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
Experience with Lakehouse architecture, Apache Spark, Delta Lake, cloud-native databases, storage solutions, and distributed compute platforms
Experience with data warehousing, third normal form (3NF), dimensional modeling, enterprise data lakes, incremental data loads, and metadata-driven ingestion and data quality frameworks using PySpark
1+ year leading complex, cross-functional data projects and technical teams, including experience with Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache Airflow, Unity Catalog, automated continuous integration and continuous deployment (CI/CD) pipelines, and performance optimization of data engineering pipelines, code, and compute resources
Ability to travel 50%, on average, based on the work you do and the clients and industries/sectors you serve.
Limited immigration sponsorship may be available.

Nice To Haves

Master’s degree in Computer Science, Engineering, or a related field
Experience in one or more of AWS, Azure, and GCP cloud ecosystems and associated big data services
Experience tuning and optimizing performance in Databricks and Apache Spark environments
Experience with Databricks Lakeflow
Experience with artificial intelligence and machine learning solutions

Responsibilities

Establish, document, and promote best-in-class approaches for data architecture, integration, and modelling.
Oversee the design, development, and maintenance of robust data pipelines and data architectures that support large-scale, enterprise data needs.
Initiate and manage efforts to improve data quality, operational efficiency, and process scalability.
Evaluate, pilot, and integrate new big data and analytics technologies, ensuring the organization remains at the cutting edge. Lead, coach, and develop teams of data engineers and architects, fostering technical growth and effective project delivery.
Consult on, design, and implement governance, security, and compliance strategies tailored to modern cloud data ecosystems.
Communicate technical concepts and business value to diverse stakeholders, including executives, business leads, and technology teams.
Oversee the implementation of CI/CD practices with tools such as Azure DevOps, AWS Code Pipeline, Jenkins, TFS, or PowerShell for streamlined deployments and operations.