Databricks Engineer

Express Employment International Headquarters • Oklahoma City, OK

1d • Onsite

About The Position

The corporate IT Services team with Express Employment International is seeking a highly skilled Databricks Engineer with advanced expertise in Databricks CI/CD pipelines and streaming table development. The ideal candidate will have hands-on experience implementing robust CI/CD processes within the Databricks environment, enabling efficient code deployment, automated testing, and streamlined release management. Key responsibilities include designing and optimizing streaming tables to support real-time analytics, ensuring seamless schema evolution to accommodate changing business requirements. Candidates should demonstrate proficiency in schema optimization techniques to maximize performance and reliability, as well as a deep understanding of data engineering best practices on the Databricks platform. This position sits within our Oklahoma City based corporate office, currently with an expectation to be onsite 80% of the time.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or equivalent experience in related field
• 5+ years of experience in data engineering, with a focus on cloud data solutions
• Proficiency in Azure cloud computing and data architecture design
• Implementation of a data lake solution using Azure Databricks, integrating various data sources, and enabling analytics for business intelligence
• Proven experience with Databricks, including CI/CD pipeline management and streaming table development
• Expertise in schema evolution and optimization within streaming data architectures
• Strong programming skills in Python and SQL
• Proficient with GIT
• Excellent problem-solving and communication abilities

Nice To Haves

• Familiarity with YAML a plus

Responsibilities

• Develop, maintain, and optimize Databricks CI/CD pipelines for automated deployment and testing
• Evaluate, understand and assist in planning for compute and job cluster resources in Azure Databricks environments
• Design and implement streaming tables with support for schema evolution and optimization
• Collaborate with data architects and business stakeholders to understand data requirements and deliver scalable solutions
• Troubleshoot and resolve issues related to table schemas, data ingestion, and streaming performance
• Ensure data quality, security, and compliance throughout the engineering process
• Databricks environmental change tracking

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees