Lead Data Engineer - Databricks
AmeriLife
1d•$150,000 - $175,000
About The Position
The Lead Data Engineer will play a key role in engineering the enterprise data platform on Databricks, building scalable pipelines and transformation frameworks that support enterprise analytics and AI initiatives.
Requirements
- Strong expertise in Python and SQL
- Deep experience with Databricks, PySpark, and Spark
- Experience building large-scale data pipelines
- Strong understanding of data transformation and distributed processing
- Strong communication and collaboration skills
- Ability to mentor engineers and influence engineering best practices
- Passion for building scalable data platforms
Nice To Haves
- Databricks certification
- AWS or Azure certification
Responsibilities
- Design and build scalable Databricks data pipelines
- Develop ETL/ELT pipelines using PySpark
- Implement data ingestion and transformation frameworks
- Optimize Spark workloads for performance and scalability
- Establish engineering standards and mentor engineers
- Collaborate with architecture and analytics teams to enable data products
Benefits
- PTO
- medical
- dental
- vision
- retirement savings
- disability insurance
- life insurance
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
Number of Employees
101-250 employees
