Senior Data Engineer

Systems Innovation Engineering

About The Position

The Senior Data Engineer provides technical leadership, analytical expertise, and program oversight in the areas of data engineering, modeling and simulation (M&S), and systems analysis. This position is responsible for managing the technical execution of complex readiness, sustainment, and logistics modeling efforts in direct support of Navy and Department of Defense (DoD) programs. Integrates multidisciplinary engineering methodologies to ensure that model development, data management, and analytical outputs align with program objectives, technical standards, and customer requirements. The ideal candidate has 5 to 8 years of experience using Orchestration tools (Apache Airflow) and data processing tools (Apache Spark) with a demonstrated ability to collaborate with cross-functional teams.

Requirements

Proficient with Orchestration tools (Apache Airflow) and data processing tools (Apache Spark)
Advanced knowledge of object storage and management of unstructured data
Experience utilizing cross-domain solutions in a secure environment
Advanced knowledge of containerization technologies supporting enterprise software deployment (Kubernetes, Docker, Helm, etc.)
Proficient knowledge of data engineering workflows such as extract, transform, load (ETL) processes and data warehousing
Advanced level knowledge of software development processes including Agile methodologies.
Conversant with object-oriented programming languages
Excellent written and oral communication.
Bachelor’s degree in engineering, science, or equivalent with demonstrated experience in technical/engineering leadership.

Nice To Haves

Current CompTIA Security + Certification
Experience with Typescript/Express and FastAPI frameworks
Experience with PostgreSQL
Experience with a modern JavaScript framework (Angular, React, etc.)
Experience with software development frameworks and libraries.
In-depth understanding of the aerospace and defense industry.
Knowledge of DoD software development policies and requirements

Responsibilities

Collaborate with software developers, data scientists, and product managers to understand requirements, gather specifications and align on project goals.
Contribute technical expertise in data engineering to design and implement data solutions that support software development initiatives.
Participate in planning sessions to develop data pipeline architecture that align with project requirements.
Design data ingestion, transformation, and storage workflows that are scalable and meet software performance requirements.
Implement data quality checks and validation procedures to ensure data accuracy and integrity within software products.
Conduct comprehensive testing, including unit, integration, and system testing ensuring application quality and functionality stay in specifications
Debug and resolve complex software defects and issues.
Document data engineering processes, pipeline configurations, and data flows to ensure consistency and future support.
Ensure accuracy and completeness of all documentation.
Foster effective collaboration with cross-functional teams to achieve project objectives.
Communicate complex technical information clearly and effectively.
Utilize advanced software development tools and methodologies to support project requirements.
Integrate software development tools and methodologies into the workflow to improve efficiency and accuracy.
Manage projects, including planning, execution, and delivery.
Coordinate with cross-functional teams to ensure project objectives are met on time and within budget.