ETL Developer

Ideal Innovations, Inc. • Bethesda, MD

12h • Onsite

About The Position

The ETL Developer provides technical support for the design, development, implementation, and testing of customer tools and applications that extract, transform, and load data into an enterprise Data Lake. The role designs, develops, and manages enterprise-scale Apache NiFi data pipelines for large-scale data ingestion, transformation, and processing from diverse sources, supporting batch and real-time workloads. It follows architectural best practices and optimizes performance in large-scale environments to deliver robust, scalable, and secure data flow solutions for critical customer needs.

Working within a DevOps framework, the ETL Developer participates in major projects throughout the software development lifecycle. The role integrates NiFi with databases, big data ecosystems, and cloud platforms and collaborates with data architects, data engineers, application and service developers, and other stakeholders to translate business requirements into technical solutions. The position is onsite in Bethesda, Maryland, with a Monday–Friday, 40-hour work week. An active TS/SCI with polygraph clearance is required; the posting also specifies a Full-Scope Polygraph (FSP) and U.S. citizenship.

Requirements

• Active TS/SCI security clearance with polygraph; the posting specifies a Full-Scope Polygraph (FSP).
• U.S. citizenship.
• Bachelor’s degree and 4 or more years of relevant experience, or a master’s degree and 2 or more years of relevant experience; experience may be considered in lieu of a degree.
• Direct experience designing, developing, and managing complex NiFi data-flow solutions in large-scale enterprise environments.
• Experience with Java and/or Python programming and scripting for automation.
• Experience writing and optimizing complex queries and interacting with relational and NoSQL databases, such as Postgres, Elasticsearch, and DynamoDB.
• Experience with real-time streaming and REST API integration.
• Experience with cloud platforms such as AWS, Azure, or OCI and related data services.
• Ability to analyze complex data challenges, identify root causes, and implement effective solutions.
• Ability to collaborate with cross-functional teams and communicate technical concepts clearly.

Nice To Haves

• Experience deploying ETL solutions in an AWS environment.
• Experience developing custom NiFi processors with Java and/or Python.
• Direct knowledge of NiFi architecture, processors, and configurations.
• Hands-on experience with NiFi Registry and clustering for high availability and scalability.

Responsibilities

• Design and implement enterprise-level NiFi ETL pipelines for large-scale ingestion, transformation, and processing of data from diverse sources.
• Optimize NiFi data flows through processor tuning, memory management, and load balancing for batch and real-time processing.
• Diagnose and resolve complex data-flow issues, including performance bottlenecks, data discrepancies, and integration failures.
• Integrate NiFi with databases, big data ecosystems, and cloud platforms such as AWS, OCI, and Azure, including services and technologies such as Kafka, Elasticsearch, S3, and SQS/SNS.
• Follow NiFi development, deployment, security, and governance best practices and enterprise data-management policies.
• Create and maintain documentation for data flows, mappings, architectures, and standard operating procedures, and support knowledge transfer.
• Collaborate with data architects, data engineers, application and service developers, and other stakeholders to translate business requirements into technical solutions.
• Support the design, development, implementation, and testing of customer tools and applications throughout the software development lifecycle.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level