Sr. Data Engineer I (6154)

MetroStar SystemsHerndon, VA
43d

About The Position

As a Sr. Data Engineer I, you'll work with team members to build, deploy, and operate data pipelines and data engineering components to enable data brokering and exchange capabilities across a diverse range of producers and consumers. In this role, you will be responsible for building robust, scalable data pipelines while working collaboratively with cross-functional teams to ensure seamless integration, optimized performance, and efficient delivery of solutions.

Requirements

  • Active TS/SCI with the ability to obtain and maintain a CI polygraph required
  • 4+ years of proven experience in data engineering, with expertise in designing, developing, and maintaining data ingestion, transformation, and loading pipelines and components
  • Demonstrated experience in designing and deploying data pipelines leveraging AWS cloud infrastructure across multiple classification domains (e.g., IL5 to IL6+)
  • Experience with Infrastructure-as-Code (IaC) tools, including Terraform, CloudFormation, or Ansible, to automate deployment of data pipeline cloud infrastructure
  • Understanding of RMF security principles and hands-on experience implementing security controls for data pipelines in cloud environments
  • Strong scripting and programming skills in languages such as Go, Python, and Bash
  • Experience with data pipeline tools and technologies such as Nifi, Hadoop, HDFS, and Kafka
  • Strong communication skills, with the ability to clearly convey complex technical concepts

Nice To Haves

  • Experience implementing data pipelines in the Cloudera Data Platform environment is highly preferred.

Responsibilities

  • Work with team members to operationalize data pipelines and supporting cloud infrastructure
  • Collaborate with external data producers and consumers to obtain and provide data through interfaces such as REST APIs and S3
  • Provide day-to-day support of deploying Python-native data pipelines and performing data engineering tasks to enable data brokering and exchange capabilities
  • Provide Tier 2/3 troubleshooting and incident resolution support for data pipelines in Production

Benefits

  • Performance-based bonuses
  • Company-paid training and/or certifications
  • Referral bonuses

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Industry

Professional, Scientific, and Technical Services

Education Level

No Education Listed

Number of Employees

101-250 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service