Principal ETL Developer

Ideal Innovations, Inc.•Bethesda, MD
•Onsite

About The Position

The Principal ETL Developer provides technical expertise and support for designing, developing, implementing, and testing customer tools and applications that extract, transform, and load data into an enterprise Data Lake. Working within a DevOps framework, the developer participates in all aspects of the software development lifecycle and follows architectural best practices to deliver robust, scalable, and secure solutions for critical customer needs. The role centers on architecting and optimizing enterprise-scale Apache NiFi data flows for batch and real-time processing. It involves integrating NiFi with databases, big data ecosystems, and cloud platforms, including AWS, Azure, and OCI, as well as services and technologies such as Kafka, Elasticsearch, S3, and SQS/SNS. The developer establishes development, deployment, security, and governance practices; troubleshoots complex data-flow issues; documents architectures and procedures; and collaborates with stakeholders to translate business requirements into technical solutions. The position also includes mentoring junior developers and conducting code reviews. This is an onsite position in Bethesda, Maryland, with a Monday–Friday, 40-hour work week. An active TS/SCI clearance with polygraph is required; the posting also specifies U.S. citizenship and a TS/SCI with Full-Scope Polygraph (FSP).

Requirements

  • Active TS/SCI security clearance with polygraph; the posting specifies a Full-Scope Polygraph (FSP).
  • U.S. citizenship.
  • Bachelor's degree with 12 or more years of relevant experience, or a master's degree with 10 or more years of relevant experience; additional years of experience may substitute for a degree.
  • In-depth experience designing, developing, and managing complex NiFi data-flow solutions in large-scale enterprise environments.
  • In-depth knowledge of NiFi architecture, processors, and configurations, and hands-on experience with NiFi Registry and clustering for high availability and scalability.
  • Proficiency in Java and Python for custom NiFi processor development and automation scripting.
  • Proficiency writing and optimizing complex queries and experience managing relational and NoSQL databases, such as Postgres, Elasticsearch, and DynamoDB.
  • Direct experience with real-time streaming and REST API integration.
  • Direct experience with cloud platforms such as AWS, Azure, or OCI and related data services.
  • Ability to analyze complex data challenges, identify root causes, and implement effective solutions.
  • Ability to collaborate across teams, clearly articulate technical concepts, and provide mentorship.

Nice To Haves

  • In-depth experience deploying ETL solutions in an AWS environment.

Responsibilities

  • Design and develop enterprise-level ETL architectures and NiFi pipelines for large-scale data ingestion, transformation, and processing from diverse sources.
  • Optimize NiFi data flows through processor tuning, memory management, and load balancing for batch and real-time processing.
  • Diagnose and resolve complex data-flow issues, including performance bottlenecks, data discrepancies, and integration failures.
  • Integrate NiFi with databases, big data ecosystems, cloud platforms, and services such as AWS, OCI, Azure, Kafka, Elasticsearch, S3, and SQS/SNS.
  • Establish best practices for NiFi development, deployment, security, and governance in accordance with enterprise data-management policies.
  • Create and maintain documentation for NiFi data flows, mappings, architectures, and standard operating procedures.
  • Collaborate with data architects, data engineers, application and service developers, and other stakeholders to translate business requirements into technical solutions.
  • Communicate technical concepts to technical and non-technical audiences.
  • Mentor junior developers, provide technical guidance, conduct code reviews, and foster collaborative learning.
  • Participate in the delivery of major projects throughout the software development lifecycle in a DevOps framework.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service