Azure Databricks Engineer
About The Position
In support of PNNL's mission, Digital Platforms collaborates closely with our business and technology partners to build and maintain innovative software solutions and robust data and analytics capabilities. We aim to be a strategic partner in delivering cutting-edge enterprise solutions that drive innovation and improve the way our staff work across the PNNL digital workplace. Our forward-thinking, agile teams leverage cloud technologies, DevSecOps, and AI to modernize existing platforms and assist in the creation of novel solutions. By integrating commercial products, custom-developed and low-code solutions, we ensure our digital platforms are ready for the challenges and opportunities of tomorrow.
Requirements
- BS/BA and 2 years of relevant experience -OR- MS/MA -OR- PhD
Nice To Haves
- 2–4 years in cloud data engineering or analytics; 1–2 years with Azure Databricks.
- Practical experience with Python, SQL, and Spark.
- Basic understanding of lakehouse concepts (bronze/silver/gold) and dimensional modeling.
- Experience with Spark or other distributed compute frameworks.
- Exposure to CI/CD (Azure DevOps or GitHub Actions).
- Awareness of Azure security and governance practices.
- Familiarity preparing data for reporting (e.g., Power BI).
- Certifications: Databricks Data Engineer, Azure Data Engineer, or related.
Responsibilities
- Build and maintain Databricks notebooks, jobs, and Delta tables across bronze/silver/gold layers.
- Develop pipelines using Python, SQL, and Spark; improve ETL/ELT performance and reliability.
- Monitor and troubleshoot jobs, clusters, and storage connections (e.g., ADLS, Key Vault).
- Help migrate legacy pipelines to Databricks and document designs and workflows.
- Collaborate with data engineers, BI developers, and analysts to refine datasets.
- Apply security and governance standards (e.g., access controls, Unity Catalog).
- Contribute to CI/CD and testing practices to improve quality and repeatability.
- Learn new platform features and tools; pursue relevant certifications.
Benefits
- medical insurance
- dental insurance
- vision insurance
- robust telehealth care options
- several mental health benefits
- free wellness coaching
- health savings account
- flexible spending accounts
- basic life insurance
- disability insurance
- employee assistance program
- business travel insurance
- tuition assistance
- relocation
- backup childcare
- legal benefits
- supplemental parental bonding leave
- surrogacy and adoption assistance
- fertility support
- company-funded pension plan
- 401 (k) savings plan with company match
- 120 vacation hours per year
- ten paid holidays per year
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
1,001-5,000 employees
