Data Engineer

AMSG•Fort Eustis, VA

1d•Hybrid

About The Position

AMSG is seeking a full-time Data Engineer with a strong background in U.S. Army data systems to support T2COM. The ideal candidate will be an expert in data engineering, responsible for designing, building, and maintaining the data architecture and pipelines that enable advanced analytics and decision-making. You will join a team of top talent dedicated to supporting critical federal government programs.

Requirements

Must possess an active Secret Security Clearance.
Proven experience as a Data Engineer or Data Architect.
Demonstrated proficiency in building ETL pipelines using PySpark.
Hands-on experience with Palantir Foundry.
Experience with U.S. Army systems and data environments (e.g., Vantage - Palantir Foundry, Advana).
Strong expertise in data modeling, designing data architectures, and defining data schemas.
Proficiency with Python in support of data engineering pipelines using Apache Spark.
Experience handling diverse data types, including structured, semi-structured, and unstructured data.
Ability to communicate to stakeholders of various levels of technical proficiency and breakdown concepts of data engineering and transformation logic.
Familiarity with Machine Learning/Artificial Intelligence concepts and their data requirements (including data structure needs).

Nice To Haves

Possess an active Top-Secret Security Clearance.
Experience supporting business intelligence and data visualization tools (e.g. Power BI, Qlik, Tableau).
Experience with other data processing technologies (e.g., Hadoop, Kafka).
General knowledge of cloud data services (AWS, Azure, etc.).

Responsibilities

Serve as the subject matter expert for data engineering and data architecture within the program.
Design, develop, and maintain robust, scalable ETL (Extract, Transform, Load) pipelines using PySpark.
Build and manage data solutions within Palantir Foundry, ensuring data is integrated and available for analysis.
Develop and implement data models, data warehouses, and data storage solutions for both operational and analytical purposes.
Experience managing CI/CD processes to include branching strategies, proposal approvals, and writing test cases to ensure data compliance with existing schema expectations.
Create and manage data pipelines that integrate data from various sources into U.S. Army data platforms such as Vantage and Advana.
Ensure data interoperability and quality by implementing data standards, structures, and governance rules.
Work with structured, semi-structured, and unstructured data, to support a variety of analytical requirements.
Collaborate with data analysts and stakeholders to understand data needs and provide the necessary infrastructure to support analytics, reporting, and visualization tools.
Provide demonstrations on data engineering efforts to an audience of varying technical backgrounds.