Data Engineer

Red Arch SolutionsTysons, VA

About The Position

As a Data Engineer , you’ll work with team members to build, deploy, and operate data pipelines and data engineering components to enable data brokering and exchange capabilities across a diverse range of producers and consumers. In this role, you will be responsible for building robust, scalable data pipelines while working collaboratively with cross-functional teams to ensure seamless integration, optimized performance, and efficient delivery of solutions. If you think you can see yourself delivering our mission and pursuing our goals with us, then check out the job description below!

Requirements

  • Active TS/SCI with CI poly required
  • 4-7 years of proven experience in data engineering, with expertise in designing, developing, and maintaining data ingestion, transformation, and loading pipelines and components
  • Demonstrated experience in designing and deploying data pipelines leveraging AWS cloud infrastructure across multiple classification domains (e.g., IL5 to IL6+)
  • Experience with Infrastructure-as-Code (IaC) tools, including Terraform, CloudFormation, or Ansible, to automate deployment of data pipeline cloud infrastructure
  • Understanding of RMF security principles and hands-on experience implementing security controls for data pipelines in cloud environments
  • Strong scripting and programming skills in languages such as Go, Python, and Bash
  • Experience with data pipeline tools and technologies such as Nifi, Hadoop, HDFS, and Kafka
  • Strong communication skills, with the ability to clearly convey complex technical concepts

Nice To Haves

  • Experience implementing data pipelines in the Cloudera Data Platform environment is highly preferred.

Responsibilities

  • Work with team members to operationalize data pipelines and supporting cloud infrastructure
  • Collaborate with external data producers and consumers to obtain and provide data through interfaces such as REST APIs and S3
  • Provide day-to-day support of deploying Python-native data pipelines and performing data engineering tasks to enable data brokering and exchange capabilities
  • Provide Tier 2/3 troubleshooting and incident resolution support for data pipelines in Production

Benefits

  • 100% paid employee healthcare premiums. CareFirst Advantage Best in Class Benefits.
  • HaloScripts Concierge prescription medication service
  • Generous PTO.
  • 10 % 401K 6% match vested day one and up to 4% profit sharing contribution.
  • Annualized bonus compensation.
  • Spot bonuses for hard work.
  • Tuition reimbursement.
  • 529 College Saving Plan.
  • College Loan Pay Back Program.
  • 11 Paid Federal Holidays
  • Generous Referral Bonuses.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service