Databricks Data Engineer - Clearance Required
The Squires Group•Arlington, VA
•Remote
About The Position
TSGi is seeking a Senior Databricks Data Engineer to support a large-scale federal technology modernization program. This remote position supports development and migration of cloud-based data solutions. The engineer will build and operate ingestion pipelines and Bronze, Silver, and Gold data layers in Databricks, helping migrate data and business logic from legacy environments into a modern cloud architecture. An active DoD Secret clearance and U.S. citizenship are required.
Requirements
- Active DoD Secret clearance and U.S. citizenship are required.
- Strong experience in data engineering, ETL/ELT development, or data warehousing.
- Strong PySpark and/or Spark SQL skills with solid SQL fundamentals.
- Experience with Databricks and Medallion Architecture, including Bronze, Silver, and Gold layering.
- Experience with Delta Lake, including ACID transactions, schema evolution, time travel, and MERGE/upsert patterns.
- Experience designing batch and incremental/streaming ingestion pipelines.
- Familiarity with Agile processes.
- Excellent written and verbal communication skills.
- Strong interpersonal, organizational, and prioritization skills.
Nice To Haves
- Databricks certification or additional hands-on Databricks experience.
- DoD, Navy, or other federal experience.
- AWS GovCloud experience.
- Experience migrating code from non-accredited to accredited AWS environments.
Responsibilities
- Build, operate, and maintain ingestion pipelines within Databricks.
- Develop and support Bronze, Silver, and Gold data pipelines using Medallion Architecture.
- Migrate data and business logic from legacy systems into modern cloud-based environments.
- Gather and analyze technical and business requirements.
- Design and develop batch, incremental, and streaming ingestion pipelines.
- Monitor data jobs and troubleshoot pipeline and production issues.
- Provide post-go-live production support and break/fix assistance.
- Document technical processes, data workflows, and procedures.
- Collaborate with technical teams and stakeholders in an Agile environment.
Benefits
- Paid time off (PTO), which may vary by compensation type.
- Medical, dental, and vision coverage, which may vary by compensation type.
- Life insurance, which may vary by compensation type.
- Long-term disability insurance, which may vary by compensation type.
- A 401(k) plan, which may vary by compensation type.
- Additional optional benefits.
- Competitive pay and multi-year projects.
- Work-life balance and support for career goals.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
