Mid Data Engineer (Databricks / PySpark)

IntelliTech LLC • Arlington, VA

7d • $110,000 - $180,000 • Hybrid

About The Position

IntelliTech is seeking a Data Engineer to support a large-scale DoD data platform and analytics environment. In this role, you will design, build, maintain, and optimize scalable data pipelines and data products that enable mission-critical analytics, reporting, and downstream data use cases in a complex enterprise setting.

The ideal candidate brings strong hands-on experience with Databricks, PySpark, Python, SQL, and cloud-based data engineering, along with a proven ability to work across large data environments, integrate disparate data sources, and deliver reliable, secure, and high-performing data solutions.

Requirements

• Active DoD Secret clearance.
• Bachelor’s degree in Computer Science, Data Science, Engineering, Information Systems, or a related technical discipline, and 4+ years of relevant experience; or Master’s degree in a related field and 2+ years of relevant experience.
• Strong hands-on experience designing, building, and maintaining production-grade data pipelines and integration solutions.
• Strong experience with Databricks, Apache Spark, and PySpark in enterprise data environments.
• Strong programming skills in Python and SQL; experience with Java or similar languages is a plus.
• Experience implementing ETL/ELT pipelines and data integration processes across multiple sources and platforms.
• Experience with relational and non-relational databases, data modeling, and query optimization.
• Experience working in cloud-based data environments such as AWS, Azure, or GCP.
• Experience with source control, CI/CD pipelines, and modern software engineering practices.
• Ability to identify and resolve issues related to data quality, pipeline performance, and operational reliability.
• Strong communication and collaboration skills, with the ability to work effectively across technical and non-technical teams.

Nice To Haves

• Active Top Secret clearance with SCI eligibility.
• Experience supporting enterprise data platforms in DoD or other federal environments.
• Experience with data governance, metadata management, lineage, and access control concepts.
• Experience supporting AI/ML data preparation and feature engineering workflows.
• Experience with Airflow, Kafka, Docker, Kubernetes, or related orchestration and containerization technologies.
• Experience supporting data engineering solutions in secure or multi-environment enterprise settings.
• Relevant cloud or data engineering certifications.

Responsibilities

• Design, develop, and maintain scalable batch and streaming data pipelines supporting enterprise analytics and data operations.
• Build and optimize Databricks and PySpark workflows for ingestion, transformation, validation, and processing of large datasets.
• Develop robust ETL/ELT solutions across structured and unstructured data sources, including APIs, relational databases, NoSQL databases, and cloud storage.
• Support data modeling, pipeline orchestration, data quality, lineage, and performance tuning across the data lifecycle.
• Implement and maintain cloud-native data engineering solutions in environments such as AWS, Azure, or GCP.
• Collaborate with engineers, analysts, data scientists, and other stakeholders to support reporting, analytics, and AI/ML data preparation workflows.
• Integrate data pipelines into DevSecOps / CI/CD workflows and support secure, repeatable deployment practices.
• Troubleshoot pipeline failures, improve observability, and optimize the performance and reliability of enterprise data services.
• Contribute to technical documentation, engineering standards, and best practices for enterprise-scale data development.
• Operate effectively within Agile / SAFe delivery environments supporting mission systems.

Benefits

• IntelliTech also offers a comprehensive benefits package designed to support our employees’ well-being and professional growth, including health, dental, and vision insurance, a 401(k) plan, paid time off, professional development opportunities, and flexible work arrangements that promote work-life balance.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level