ETL Developer

GRVTY•McLean, VA

1d•$150,000 - $250,000

About The Position

GRVTY is seeking an ETL Developer with an active TS/SCI with Polygraph clearance to join a project in McLean, Virginia. The role focuses on developing, maintaining, and optimizing data pipelines that deliver reliable data to a PostgreSQL database, including large and complex datasets and geospatial data. The developer will work with Apache NiFi, AWS, PostgreSQL, APIs, SQL, Python, containerized infrastructure, Git, and NiFi Registry to support a geospatial visualization platform and related data science efforts. The position involves learning and supporting existing NiFi flows and infrastructure, creating and refining flows according to established practices and analyst feedback, and collaborating with analysts to translate data needs into specific work. It also includes supporting geospatial database design, data quality and performance, and distinguishing experimental data science prototypes from enterprise software requirements. The role is based in McLean, VA. The listed Virginia pay range is $150,000–$250,000.

Requirements

Active TS/SCI with Polygraph clearance.
Bachelor’s degree in Computer Science, Systems Engineering, Geography, or a related technical field, or equivalent experience.
Minimum experience requirement: 8 years with a bachelor’s degree, 7 years with a master’s degree, or 6 years with a doctorate.
Experience developing NiFi flows using existing best practices.
Strong understanding of ETL concepts and best practices.
Strong experience with databases for data management.
Proficiency in SQL for querying large datasets.
Experience with API integration and data retrieval.
Demonstrated experience with programmatic data manipulation.
Ability to rapidly develop proficiency with containerized development.
Ability to rapidly develop proficiency with AWS architecture.
Ability to rapidly develop proficiency with NiFi Registry and Git for code management.

Nice To Haves

Creativity to experiment with and recommend best-practice coding improvements.
Drive to adopt and recommend AI in development processes.
Ability to design and develop custom NiFi processors using Java.
Experience with AWS cloud services for data ingestion and processing.
Strong experience with PostgreSQL for data management.
Hands-on experience with Apache Airflow.
Hands-on experience with Apache NiFi.
Hands-on experience with NiFi Registry and Git.
Hands-on experience with Git repository actions and pull requests.
Hands-on experience with Python for data manipulation and API interfacing.
Experience working with geospatial data and related tools.
Understanding of basic data science concepts and tools.

Responsibilities

Design, develop, and manage Apache NiFi ETL workflows for a geospatial visualization platform.
Learn the existing NiFi system and related AWS and PostgreSQL infrastructure to monitor and troubleshoot real-time issues.
Understand existing NiFi flows with minimal support and develop new flows following their best practices.
Incorporate feedback and requested changes into NiFi flows.
Take direction and communicate work status through a ticketing system.
Work with analysts by email, chat, and in-person meetings to understand future data-flow needs and translate general requirements into specific actions.
Use a local development environment with containerized infrastructure, version control through Git, and NiFi Registry.
Build competency in geospatial database design and apply best practices for table creation, indexing, and unique constraints.
Incorporate analyst feedback on requirements for application data layers.
Programmatically manipulate and transform data from multiple sources.
Query and analyze large datasets using SQL.
Retrieve and process data from external systems through APIs.
Support data quality, integrity, and performance optimization efforts.
Understand Python and data science frameworks, distinguishing experimental prototypes from enterprise-level software requirements.
Develop Python in support of data science efforts or ETL prototypes.

Benefits

Robust health plan including medical, dental, and vision coverage.
Health Savings Account with company contribution.
Annual paid time off and paid holidays.
Paid parental leave.
401(k) with generous company match.
Training and development opportunities.
Award programs.
Company-sponsored events.
Competitive pay and opportunities for professional growth.
Benefits supporting healthcare, financial wellness, retirement planning, family assistance, continued education, and paid time off.