Data Engineer (Remote)

West 4th Strategy•Arlington, VA

2d•$125,000 - $135,000•Remote

About The Position

The National Guard Bureau (NGB) is seeking an experienced Data Engineer to support operations on the Minuteman project team. The team manages the NGB's enterprise data environment within the Department of War's central analytics platform and supports the Minuteman Community Space's data infrastructure and systems. The Data Engineer designs, develops, and maintains end-to-end data pipelines using ETL processes and technologies including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL. The role works with cross-functional teams to understand data requirements and design effective data models and architectures for efficient processing and analysis. This is a full-time, remote opportunity supporting OUSD Personnel & Readiness (P&R). An active Secret security clearance and U.S. citizenship are required. The position is classified as W2 employment, offers a salary range of $125,000–$135,000, and includes a benefits package.

Requirements

Three to ten years of directly related experience.
At least three years of experience as a Data Engineer.
Proficiency in ETL processes and firsthand experience with Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks.
Experience working with large datasets and using big data technologies to process and analyze data efficiently.
Understanding of data modeling and visualization, database design principles, and data governance practices.
B.A./B.S. or M.A./M.S. in a related field.
Active Secret security clearance.
U.S. citizenship is required because the role supports the U.S. Federal government.

Nice To Haves

Experience with the Department of War mission and associated datasets.
Previous experience with Advana or the War Data Platform.
Experience with APIs.
Experience with Machine Learning models and/or Generative AI.
Experience building applications within Palantir Foundry, including Workshop, Ontology Manager, and Gaia.

Responsibilities

Design, develop, and implement end-to-end data pipelines using ETL processes and technologies such as Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL.
Work with cross-functional teams to understand data requirements and design data models and architectures.
Create and optimize data pipelines from scratch for scalability, reliability, and high-performance processing.
Perform data cleansing, data integration, and data quality assurance to maintain the accuracy and integrity of large datasets.
Use big data technologies to process and analyze large datasets efficiently.
Collaborate with data scientists, analysts, and stakeholders to provide timely and accurate data insights and support decision-making.
Troubleshoot data-related problems and develop solutions to complex data challenges.
Implement and enforce data governance policies and procedures to support regulatory compliance and industry best practices.