ETL Developer - TS/SCI with Polygraph

Orchard•McLean, VA

2d•Onsite

About The Position

@Orchard is recruiting an experienced ETL Developer to provide onsite support for a geospatial visualization platform in the Intel sector. The role advances the national security mission by developing, maintaining, and optimizing data pipelines that provide reliable data flow into a PostgreSQL database. The developer will work collaboratively with analysts and technical teams, learn and support existing Apache NiFi flows and related AWS and PostgreSQL infrastructure, and develop new flows that follow established best practices. The position also involves integrating and transforming data from multiple sources, querying large datasets with SQL, retrieving data from external systems through APIs, and supporting data quality, integrity, and performance optimization. The developer will use a local containerized development environment and version control through Git and NiFi Registry, and will contribute Python work supporting data science efforts or ETL prototypes. The role requires active TS/SCI clearance with polygraph, U.S. citizenship, and full-time onsite work in McLean, Virginia.

Requirements

Bachelor’s degree with at least 8 years of relevant experience, or a master’s degree with at least 7 years, or a doctorate with at least 6 years.
Degree in Computer Science, Systems Engineering, Geography, or a related technical field.
Active TS/SCI clearance with required polygraph.
U.S. citizenship.
Willingness to work onsite full-time.
Willingness to develop NiFi flows using existing best practices.
Strong understanding of ETL concepts and best practices.
Strong experience with databases for data management.
Proficiency in SQL for querying large datasets.
Experience with API integration and data retrieval.
Demonstrated experience with programmatic data manipulation.
Ability to rapidly adopt containerized development practices.
Ability to rapidly adopt AWS architecture practices.
Ability to rapidly adopt NiFi Registry and Git for code management.

Nice To Haves

Creativity to experiment with and recommend best-practice coding improvements.
Drive to adopt and recommend AI in development processes.
Ability to design and develop custom NiFi processors using Java.
Experience with AWS cloud services for data ingestion and processing.
Strong experience with PostgreSQL for data management.
Hands-on experience with Apache Airflow.
Hands-on experience with Apache NiFi.
Hands-on experience with NiFi Registry and Git.
Hands-on experience with Git, repository actions, and pull requests.
Hands-on experience using Python for data manipulation and API interfacing.
Experience working with geospatial data and related tools.
Understanding of basic data science concepts and tools.

Responsibilities

Design, develop, and manage Apache NiFi ETL workflows for a geospatial visualization platform.
Learn the existing NiFi system and related AWS and PostgreSQL infrastructure to monitor and troubleshoot real-time issues.
Understand existing NiFi flows with minimal support and develop new flows following their best practices.
Incorporate feedback and requested changes to NiFi flows.
Take direction and communicate status through a ticketing system.
Work with analysts by email, chat, and in-person meetings to understand future data-flow needs and translate general requirements into specific actions.
Use a local development environment with containerized infrastructure and version control through Git and NiFi Registry.
Develop competency in geospatial database design and apply best practices for table creation, indexing, and unique constraints.
Incorporate analyst feedback about nuances needed to support application data layers.
Programmatically manipulate and transform data from multiple sources.
Query and analyze large datasets using SQL.
Retrieve and process data from external systems through APIs.
Support data quality, integrity, and performance optimization efforts.
Distinguish experimental prototypes from enterprise-level software requirements when working with Python and data science frameworks.
Develop Python code in support of data science efforts or ETL prototypes.