Lead Data Engineer

The MITRE Corporation•New Bedford, MA

21d•$155,200 - $232,800•Hybrid

About The Position

MITRE’s Data Science and Engineering department is looking for qualified applicants to bring their advanced data engineering skills to bear on solving problems of critical national importance. MITRE’s diverse work program provides opportunities to apply your expertise and creative thinking in challenging domains such as national security, intelligence, transportation, and healthcare. Employees may also participate in MITRE’s internal research and development program, which provides funding for innovative applied research that addresses our sponsors’ hardest problems.

Requirements

Bachelor’s degree in Computer Science, Software Engineering, Information Systems, Information Technology, or related field with 8 years of relevant experience.
Advanced, hands-on proficiency with Data Engineering approaches, including distributed data processing, cloud-based data platforms, data lakehouse architectures, ETL orchestration, data modeling, and data governance.
Active DoD Top Secret Clearance.
U.S Citizenship is required.
Advanced proficiency in Python and SQL required.
Software Engineering Best Practices (e.g., version control, testing, modular design)
Linux-based Development Environments, Git, and Cloud Platforms
Use of Containerization and Orchestration, such as Docker and Kubernetes

Nice To Haves

Master’s degree in Computer Science, Software Engineering, Information Systems, Information Technology, or related field with 6 years of relevant experience; PhD in Computer Science, Software Engineering, Information Systems, Information Technology, or related field with 3 years of relevant experience.
Active DoD Top Secret Clearance with Counterintelligence (CI) Polygraph.
Distributed Data Processing and Big Data Architectures, such as Spark, Hadoop, Ray, Dask
Data Storage and Data Lakehouse Architectures, such as RDBMS, Amazon S3, Iceberg, Delta Lake
Cloud-based Data Platforms, such as Databricks, Palantir Foundry, Microsoft Fabric, and Amazon EMR
Data Pipeline/ETL Development, Integration, and Orchestration, such as Airflow, Dagster, NiFi
Batch and Streaming Data Processing
Data Modeling, Schema Design, and Data Quality Assessment
Data Governance, Access Controls, and Secure Data Handling
Performance Optimization and Reliability Engineering

Responsibilities

Design, build, and operate secure, scalable, and maintainable data platforms and pipelines in cloud-based and self-hosted environments.
Develop batch and streaming data-processing solutions for structured, semi-structured, and unstructured data.
Create data models, schemas, interfaces, and storage architectures that support mission and analytical requirements.
Evaluate and improve data quality, lineage, governance, access controls, and secure data-handling practices.
Translate sponsor and stakeholder needs into technical requirements and practical engineering solutions.
Diagnose complex system, performance, reliability, and data-quality problems.
Evaluate emerging data technologies and recommend their use when they provide meaningful mission or engineering benefits.
Establish and promote software engineering practices such as automated testing, version control, code review, modular design, observability, and continuous integration.
Communicate complex technical concepts clearly to both technical and non-technical audiences.
Contribute to applied research, prototypes, and technical publications, as appropriate.
Lead technical workstreams or complex projects involving multiple contributors, dependencies, risks, and stakeholders.
Mentor engineers and transfer technical knowledge across teams.