Databricks Data Engineer

Diaconia LLC • Silver Spring, MD

1h • Hybrid

About The Position

We are seeking a Databricks Data Engineer with strong hands-on experience in Python and PySpark to support a fast-paced, high-impact delivery environment. This role requires someone who can quickly step in, take ownership, and deliver scalable data solutions with minimal ramp-up.

Requirements

• 3 to 5 years of experience in Databricks is required.
• Strong hands-on experience with Databricks, Python, PySpark, and SQL
• Proven experience building and optimizing ETL pipelines
• Experience working with large-scale data environments
• Solid understanding of cloud platforms (AWS and/or Azure)
• Familiarity with Medallion architecture (Delta Lake)
• Ability to work independently in fast-paced, deadline-driven environments
• Bachelor's degree in information systems, computer science, or other related field. Will accept a suitable combination of education, training, or experience
• Federal Health Agency within the U.S. Department of Health and Human Services Public Trust clearance

Nice To Haves

• Experience with Delta Lake
• Exposure to data governance and data quality frameworks
• Prior experience in federal or regulated environments
• Someone who can hit the ground running with minimal onboarding
• Strong sense of ownership and accountability
• Ability to deliver under tight timelines without compromising quality
• Proactive problem-solver with a delivery-first mindset

Responsibilities

• Design, develop, and optimize data pipelines and ETL workflows using Databricks
• Build scalable data processing solutions leveraging PySpark and Python
• Work with large-scale datasets across cloud platforms (AWS and/or Azure)
• Implement and maintain Medallion Architecture (Bronze, Silver, Gold layers)
• Ensure data quality, performance optimization, and reliability of data pipelines
• Collaborate with cross-functional teams to support data-driven initiatives

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level