Data Engineer SME

AnaVation•Chantilly, VA

34d•Onsite

About The Position

AnaVation is seeking a highly skilled Senior-level Data Engineer to join our team deliver engineering tasks to advanced analytic applications across classified environments. You will develop sophisticated data pipelines and ETL processes for desktop and web-based analytic software, facilitate the bulk analysis of relational information, and enable applications that deliver data from diverse data sources.

Requirements

Bachelor's degree in Computer Science, Data Science, Engineering, or related field
Minimum of 10 years of experience in data engineering or related field
Active Top Secret (TS) clearance with eligibility for Sensitive Compartmented Information (SCI)
Experience with SAFe Agile framework
Strong understanding of forensic and investigative data requirements
Demonstrated experience designing and implementing data solutions in secure government environments
Advanced proficiency with
Python for data processing, automation and ETL workflow orchestration
SQL (MySQL, PostgreSQL, Microsoft SQL) and query optimization
Elasticsearch or Opensearch (design, scaling, query optimization, cluster management)
Data pipeline technologies (Apache Nifi, Cribl)
Cross-domain ETL solutions for secure data transfer between classification levels
Containerization and orchestration technologies (Docker, Kubernetes)
Cloud platforms (AWS GovCloud, SC2S, C2S)
Experience handling data in accordance with IC security protocols and classification guidelines
IC Data Services frameworks and integration protocols
GraphQL: schema design, API development, query optimization, and integrations
DevSecOps practices and tools in classified environments
RabbitMQ and Redis
Must be a U.S. citizen and able to pass a background check and polygraph examination

Nice To Haves

Experience with Intelligence Community Data Services and standards
Prior work with cross-domain solutions for ETL processes
Knowledge of IC specific data formats, schemas and transfer protocols
Experience with specialized IC analytics platforms and data repositories
Prior work integrating intelligence data across multiple enclaves
Cloud certification

Responsibilities

Design and implement complex data pipelines and ETL processes to support cyber investigative capabilities across multi-classification domains
Architect and develop ETL workflows for highly sensitive data in classified environments
Support IC Data Services requirements by integrating various intelligence data sources and systems
Develop and maintain data analytics solutions for desktop and web-based visual analytic applications
Establish applications that produce manageable, actionable intelligence from streams of structured and semi-structured data
Design strategies for enterprise database systems and set standards for operations, programming, and security
Construct and optimize large relational databases across multi-enclave environments (Unclassified, Secret, and Top Secret)
Tune performance of large-scale data workflows, ensuring cost efficiency, low latency, and high availability
Design and manage Elasticsearch/Opensearch clusters for fast search, indexing, and retrieval of large-scale datasets
Integrate new systems with existing warehouse structures and refine system performance and functionality
Implement CI/CD pipelines for data systems, automate monitoring/alerting, and enforce infrastructure-as-code practices
Provide technical leadership and mentorship to other team members
Participate in Program Increments (PIs) and Agile Release Train (ART) activities