Data Engineer
About The Position
We are seeking highly skilled Data Engineers (DA II / DA III) to support a critical federal data modernization initiative focused on enterprise financial management, general ledger analytics, and large-scale data integration efforts. This role is ideal for professionals with strong experience building and optimizing data pipelines, working with Databricks, and supporting cloud-based data platforms within federal environments. The selected candidates will play a key role in developing scalable data solutions, implementing automated data quality controls, and supporting advanced analytics initiatives leveraging AWS GovCloud and the Advana platform. Work location is hybrid including majority remote with meetings in Tysons Corner and Crystal City.
Requirements
- Active Interim Secret Clearance or higher is required
- Demonstrated experience building, managing, and optimizing data pipelines within the Advana platform
- Hands-on experience with Databricks, including: Delta Lake, Autoloader, Job Scheduling
- Experience designing and implementing ETL/ELT processes
- Experience with data wrangling techniques including: Data Cleansing, Data Transformation, Data Aggregation
- Proven experience supporting large-scale Federal Financial Management (FM) and General Ledger (GL) data environments
- Experience with Universe of Transactions (UoT) reconciliations
- Experience working within AWS GovCloud environments
- Experience utilizing cloud services such as Amazon S3
- Familiarity with Medallion Architecture (Bronze, Silver, Gold)
- Experience implementing data quality frameworks and automated validation processes
- Advanced Python development skills
- Strong experience with: PySpark, Pandas
- Expert-level SQL development and optimization
- Experience with GitLab and version control best practices
- Strong understanding of CI/CD principles and DevSecOps methodologies
- Ability to troubleshoot, optimize, and scale complex enterprise data pipelines
- Excellent communication and stakeholder engagement skills
Nice To Haves
- Experience with Unity Catalog for data governance
- Knowledge of SAP data structures
- Experience supporting Department of Defense (DoD) financial systems
- Familiarity with enterprise data governance and metadata management frameworks
Responsibilities
- Build, manage, optimize, and maintain enterprise data pipelines within the Advana platform
- Design, develop, and implement scalable ETL/ELT processes to support large-scale data integration and analytics requirements
- Develop data ingestion frameworks utilizing Databricks technologies including Delta Lake, Autoloader, and scheduled jobs
- Perform data cleansing, transformation, aggregation, and enrichment activities across multiple financial data sources
- Support Federal Financial Management (FM) and General Ledger (GL) data initiatives
- Analyze and reconcile Universe of Transactions (UoT) data to ensure financial data accuracy and consistency
- Implement and maintain Medallion Architecture frameworks (Bronze, Silver, Gold layers)
- Develop automated data validation, monitoring, and quality assurance processes
- Collaborate with data analysts, product owners, engineers, and business stakeholders to deliver high-quality data solutions
- Optimize performance of large-scale data pipelines and troubleshoot complex data processing issues
- Support cloud-based data environments within AWS GovCloud
- Contribute to CI/CD pipeline development and DevSecOps best practicea
- Maintain technical documentation and support data governance initiatives
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
