Principal ETL Developer

Ideal Innovations, Inc.•Bethesda, MD
•$131,300 - $201,748•Onsite

About The Position

The Principal ETL Developer provides technical expertise and support for designing, developing, implementing, and testing customer tools and applications that extract, transform, and load data into an enterprise Data Lake. Working within a DevOps framework, the developer contributes throughout the software development lifecycle and follows architectural best practices to deliver robust, scalable, secure data-flow solutions for critical customer needs. The role focuses on designing and optimizing Apache NiFi pipelines for large-scale batch and real-time data ingestion, transformation, and processing; integrating NiFi with databases, big-data ecosystems, and cloud platforms; resolving complex data and integration challenges; and establishing development, deployment, security, and governance standards. The position also involves documenting data flows, mappings, architectures, and procedures, collaborating with technical and non-technical stakeholders, and mentoring junior developers.

Requirements

  • Active TS/SCI security clearance with a full-scope polygraph is required.
  • U.S. citizenship is required.
  • Bachelor's degree with 12 or more years of relevant experience, or a master's degree with 10 or more years of relevant experience; additional years of experience may substitute for a degree.
  • In-depth experience designing, developing, and managing complex NiFi data-flow solutions in large-scale enterprise environments.
  • In-depth knowledge of NiFi architecture, processors, and configurations, with hands-on experience using NiFi Registry and clustering for high availability and scalability.
  • Proficiency in Java and Python for custom NiFi processor development and automation scripting.
  • Proficiency writing and optimizing complex queries and experience managing relational and NoSQL databases, such as Postgres, Elasticsearch, and DynamoDB.
  • Direct experience with real-time streaming and REST API integration.
  • Direct experience with cloud platforms such as AWS, Azure, or OCI and their related data services.
  • Ability to analyze complex data challenges, identify root causes, and implement effective solutions.
  • Ability to collaborate with cross-functional teams, communicate technical concepts clearly, and provide effective mentorship.

Nice To Haves

  • In-depth experience deploying ETL solutions in an AWS environment.

Responsibilities

  • Design and develop enterprise-level ETL architectures and Apache NiFi pipelines for large-scale data ingestion, transformation, and processing from diverse sources.
  • Optimize NiFi data flows through processor tuning, memory management, and load balancing for batch and real-time processing.
  • Diagnose and resolve complex data-flow issues, performance bottlenecks, data discrepancies, and integration failures.
  • Integrate NiFi with databases, big-data ecosystems, and cloud platforms, including services such as Kafka, Elasticsearch, S3, and SQS/SNS.
  • Establish NiFi development, deployment, security, and governance best practices in accordance with enterprise data-management policies.
  • Create and maintain documentation for data flows, mappings, architectures, and standard operating procedures, and support knowledge transfer.
  • Collaborate with data architects, data engineers, application and service developers, and other stakeholders to turn business requirements into technical solutions and communicate technical concepts clearly.
  • Mentor junior developers, provide technical guidance, conduct code reviews, and foster a collaborative learning environment.
  • Contribute to the design, development, implementation, and testing of customer tools and applications throughout the software development lifecycle.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service