Senior Databricks Engineer

Shree Narayani Networking Solutions•Plano, TX

2d•Hybrid

About The Position

The Senior Databricks Engineer will join the Data Engineering team to support enterprise data modernization initiatives. Working closely with Application Leads, Data Engineers, Architects, and business stakeholders, this hands-on Databricks subject matter expert will design, implement, optimize, and govern solutions on the Databricks Lakehouse Platform. The role guides teams on implementation best practices, governance, security, performance optimization, cost management, and CI/CD while supporting the migration of Oracle-based data warehouse workloads to Databricks. The position is a 12–24-month contract based in Plano, Texas, or Charlotte, North Carolina, with a hybrid schedule requiring four onsite days each week.

Requirements

At least 5 years of Data Engineering experience.
At least 3 years of hands-on Databricks implementation experience.
Strong knowledge of the Databricks Lakehouse Platform, Delta Lake, Unity Catalog, and Delta Sharing.
Experience implementing RBAC, security, governance, and data lineage solutions.
Proven experience with Databricks performance tuning and cost optimization.
Experience implementing CI/CD pipelines using Git, Azure DevOps, GitHub, Jenkins, or similar tools.
Experience supporting cloud-based data platforms such as Azure, AWS, or GCP.
Strong understanding of data warehousing concepts and modern data architectures.
Excellent communication and stakeholder collaboration skills.
Strong problem-solving and analytical skills.
Ability to influence and guide technical teams through expertise and collaboration.
Self-motivation and a continuous improvement mindset.
Strong teamwork and communication skills.

Nice To Haves

Experience supporting Oracle-to-Databricks migration and modernization programs.
Familiarity with Informatica PowerCenter and/or Informatica IDMC environments.
Experience with Databricks Genie, AI/BI Dashboards, and Databricks SQL.
Experience integrating Databricks with Power BI.
Knowledge of Databricks Workflows, Auto Loader, Delta Live Tables (DLT), Lakeflow, and MLflow.
Experience with Infrastructure as Code tools such as Terraform.
Databricks certifications.

Responsibilities

Design and implement scalable data solutions using the Databricks Lakehouse Platform.
Partner with Application Leads and Engineering teams to define implementation approaches and best practices.
Optimize Databricks environments for performance, scalability, reliability, and cost efficiency.
Implement and support Unity Catalog, data governance, lineage, and security controls.
Design and manage data access controls.
Implement Delta Sharing for secure internal and external data sharing.
Support Oracle-to-Databricks modernization and migration initiatives.
Establish and enhance CI/CD processes, deployment automation, and DevOps best practices.
Design, build, and manage semantic data models and business layers for Databricks SQL, AI/BI Dashboards, Genie, Power BI, and enterprise analytics.
Develop standards, reusable patterns, and implementation guidance for application teams.