ETL Data Engineer

Noblis•Reston, VA

3d•Onsite

About The Position

Noblis is seeking a fully cleared Data Engineer with a TS/SCI and a Polygraph to join our team in Reston, Virginia! As the ETL Developer, you will analyze client challenges and develop innovative solutions by identifying and applying emerging tools and technologies to design and implement new data repositories. You will be responsible for maintaining and expanding the data pipelines that support critical national security missions, as well as managing data and data flows across both existing and new systems. Working closely with our team and cyber analysts, you will apply data engineering expertise to identify, integrate, and operationalize relevant datasets to support mission objectives. The ideal candidate will have a strong background in Python-based data workflows and experience working in classified Intelligence Community (IC) environments. Additional experience supporting a broad range of data engineering functions, including data extraction, transformation, and loading (ETL), data mapping, data analysis, analytical support, operational support, database support, and the maintenance of data and associated systems.

Requirements

Active Top Secret/SCI (TS/SCI) clearance with a current Polygraph.
U.S. Citizenship is required.
Bachelor’s degree with 3 years of related experience; OR Master’s degree with 1 year of related experience; OR associate’s degree with 6 years of related experience; OR High School diploma/GED with 9 years of related experience.
Experience performing extract, transformation, load (ETL) development for data pipelines (specifically cyber data); to include integrating, cleansing, and preparing data from sources for analytics and reporting.
Proficient in data warehousing, data management, programming (e.g., Python), and ETL tools (e.g., Apache NiFi, Pentaho, Kafka).
Familiarity with the cyber domain.
Experience designing and maintaining SQL-based data systems and crafting complex queries.
Experience designing and deploying interactive dashboards and integrating data systems with visualization and analytics platforms using Tableau and/or Power BI.
Experience with a cloud environment (e.g., GCP, AWS), including its security containerization technologies (e.g., Docker, Kubernetes).
Language experience with Python.
Experience with Git-based workflows and code repository platforms such as GitHub.
Ability to perform API service development.

Nice To Haves

Experience with Hadoop and Spark
Experience with Elasticsearch
Experience with open-source cyber data sets such as Shodan and Censys.IO
Experience with creating and implementing Artificial Intelligence (AI) models and tools

Responsibilities

Developing, maintaining, and executing data extraction pipelines to transport data in and out of multiple environments.
ETL Development and Data Cleansing: Engineering Python-based ETL pipelines to ingest, clean, and optimize large datasets from various sources, refining data quality and processing efficiency.
Data Preparation: Applying Python and SQL for data cleaning, integration, and exploratory analysis to uncover valuable insights extracted from large volumes of data.
Data Visualization: Designing and deploying interactive dashboards and reporting in visualization tools (e.g., Tableau, Power BI)
Improving application performance by optimizing and executing SQL queries to support data handling.
Loading data into storage systems like databases or data warehouses.
Building and maintaining data infrastructure (e.g., NiFi, Pentaho, Hevo).
Maintaining and documenting ETL workflows and recording data movement/changes.
Working in an Agile environment to rapidly iterate with our clients.
Cross-functional collaboration: Partner closely with data scientists, data engineers, and application developers to translate complex business requirements into robust technical implementations.