Data Engineer (Senior/Expert)
About The Position
NS2 Mission is seeking a Senior/Expert Data Engineer to support its Data Pipeline team in Chantilly, Virginia. The role focuses on developing, optimizing, and sustaining reliable, scalable data pipelines and cloud-based platforms that support mission objectives. The engineer will address complex data engineering challenges, develop production-ready data processing solutions, and optimize workflows across the data lifecycle. The position collaborates with software engineers, other data engineers, and mission stakeholders to translate operational requirements into effective solutions. The engineer will take ownership of critical initiatives, contribute to technical decisions, improve pipeline performance, and help modernize mission data capabilities in an Agile development environment.
Requirements
- Bachelor's degree in Computer Science, Data Engineering, Software Engineering, Information Systems, or a related technical discipline, or an equivalent combination of education and experience.
- Approximately 8–12 years of experience in data engineering, software engineering, or a related technical field; experience should align with Senior through Expert-level responsibilities.
- Demonstrated experience across the ETL lifecycle, including pipeline design, development, optimization, and sustainment.
- Strong proficiency in Python for developing and maintaining production-grade data processing applications.
- Hands-on experience designing, implementing, or supporting solutions in AWS, including services such as EC2, Lambda, EKS, and S3.
- Proven ability to develop, troubleshoot, and optimize scalable data solutions in production environments.
- Strong understanding of data engineering principles, data modeling, performance tuning, and data quality practices.
- Experience collaborating in Agile engineering teams to deliver and sustain complex technical solutions.
- Ability to independently analyze technical challenges, recommend effective solutions, and take ownership of engineering deliverables.
- TS/SCI with FSP clearance.
Nice To Haves
- Experience with workflow orchestration and scheduling tools such as Apache Airflow.
- Experience with containerization and orchestration technologies, including Docker and Kubernetes.
- Familiarity with Infrastructure as Code tools such as Terraform.
- Experience with CI/CD pipelines and DevOps practices supporting automated testing, deployment, and sustainment.
- Experience processing large datasets using distributed data processing technologies or frameworks.
- Experience improving existing data architectures, modernizing legacy workflows, or increasing data-platform scalability and resilience.
Responsibilities
- Lead the design, development, enhancement, and maintenance of scalable ETL pipelines and enterprise data workflows.
- Develop and optimize Python-based data processing applications for complex production requirements.
- Engineer ingestion, transformation, and integration solutions for structured and unstructured data across multiple platforms.
- Evaluate and improve pipeline architecture, processing efficiency, data quality, and system reliability.
- Design, implement, and sustain cloud-based data engineering solutions in AWS environments.
- Collaborate with cross-functional engineering teams and mission stakeholders to define technical approaches and deliver solutions aligned with mission needs.
- Diagnose complex pipeline issues, identify root causes, and implement improvements to operational stability.
- Modernize, automate, and optimize data engineering processes and workflows.
- Support and guide testing, deployment, integration, and sustainment activities across the data platform.
- Establish and promote best practices for code quality, scalability, maintainability, and performance.
- Produce and maintain technical documentation covering system design, data workflows, and engineering processes.
- Contribute technical expertise during Agile planning, design reviews, and implementation discussions to help ensure solutions meet performance and mission requirements.
Benefits
- The company offers a benefits package designed to support employees and their families; specific benefits are not listed in the posting.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
