About The Position

As a Senior/Lead Data Flow Engineer, you will lead efforts in strategic data acquisition, analysis, and sharing. This role focuses on building and managing software infrastructure for large-scale big data ingestion. You will be responsible for modifying existing data sources, implementing testing/monitoring, and troubleshooting complex dataflow issues. You will act as a technical lead, ensuring data integrity and fostering innovation within the department while solving high-level technical problems from ingest to visualization.

Requirements

  • 14+ years of experience in software development, data engineering, or database engineering (4 additional years of experience can substitute for a degree).
  • High proficiency in Java (including Unit/Integration testing) and significant experience with Apache NiFi administration and data flow building.
  • Experience with AWS S3 and SQS solutions, Kafka, Maven, and GitLab.
  • Expertise in ETL creation, data modeling design, and Linux OS (BASH) server administration.
  • Fluency with data extraction, custom logic development, and familiarity with YAML, JSON, and XML.
  • DoD IAT II or higher (Sec+, etc) required for consideration.
  • An active TS/SCI is required for consideration.

Nice To Haves

  • Experience with Apache Airflow, Mage AI, Docker/Kubernetes, and prior cyber security operations support.

Benefits

  • fully-paid medical
  • 4 weeks PTO
  • 6% 401k match
  • over $5k for training

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Education Level

No Education Listed

Number of Employees

1-10 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service