Senior Data Engineer

Quartermaster•Arlington, VA

1d•Hybrid

About The Position

We are seeking a highly experienced Senior Data Engineer (7+ years experience) to design, build, and maintain secure, resilient, and scalable data systems supporting mission-critical maritime and defense applications. This role requires deep expertise in AWS and Azure environments, distributed systems, and secure data architecture. The ideal candidate has experience working with government contractors, military systems, or regulated environments and understands the operational demands of real-time, high-availability data platforms. Familiarity with GIS, streaming architectures, SDR/radio systems, radar pipelines, maritime domain awareness systems, or military data management is strongly preferred.

Requirements

7+ years of professional experience in Data Engineering.
Proven experience building production-grade data pipelines.
Strong hands-on experience with AWS (RDS, EC2, S3, IAM, VPC).
Experience with Azure data services.
Database expertise in MongoDB and PostgreSQL.
Proficiency in Python, TypeScript, and SQL.
Experience implementing high-availability, replication, and disaster recovery strategies.
Experience working in government, defense, or regulated environments.
Active security clearance OR ability to obtain/maintain clearance.

Nice To Haves

Experience with GIS systems and geospatial data architectures.
Experience with real-time streaming frameworks (Kafka, Kinesis, Spark, Flink).
Familiarity with SDR, radio frequency data, radar systems, GIS, or maritime domain awareness platforms.
Experience managing high-velocity time-series or sensor data.
AWS certifications (Solutions Architect, DevOps, Data Analytics).
Microsoft Azure certifications.
Experience with containerization (Docker, Kubernetes).
Infrastructure-as-code (Terraform, CloudFormation, Bicep).
Security+ or similar certification preferred in secure environments.

Responsibilities

Design, build, and maintain scalable batch and real-time machine learning, data science, and data export pipelines.
Architect and manage AWS and Azure cloud infrastructure.
Administer and optimize databases including MongoDB and PostgreSQL using RDS and EC2-hosted environments.
Implement replication strategies, failover systems, and resiliency management for high-availability operations.
Design systems that strictly separate public and private/classified data.
Support high-throughput streaming ingestion and processing (sensor, radar, SDR, maritime feeds).
Develop infrastructure-as-code and automated deployment pipelines.
Ensure secure-by-design architecture aligned with compliance requirements.
Provide guidance and architectural leadership for handling data at scale.
Monitor performance, reliability, and cost optimization across environments.
Collaborate with DevSecOps, AI/ML, and mission teams to deliver operational capabilities.