Data Operations Engineer

SAIC•Town of Cortlandt, NY
•Onsite

About The Position

The Data Operations Engineer designs, builds, and maintains real-time and near-real-time data ingestion pipelines for a mission-critical system. The role supports reliable streaming data flow from varied sources into the data platform while ensuring data quality, observability, and scalability. It includes moving data across security domains using cross-domain solutions (CDS) or guards, in compliance with transfer policies and data-classification requirements. The engineer works closely with data engineers, platform engineers, analytics teams, and security and governance personnel to deliver trustworthy, low-latency data for operational decisions. This position is on-site in Honolulu, Hawaii.

Requirements

  • U.S. citizenship and an active TS/SCI clearance.
  • Bachelor of Science degree in Computer Science, Mathematics, Electrical Engineering, Physics, Information Systems, Information Technology, or a related field; the posting also describes typical experience as a bachelor's degree with two or more years of experience, or a master's degree with zero years of related experience.
  • Proficiency in Python, Bash, or similar scripting languages commonly used in data science or data analytics applications.
  • Working knowledge of the Linux (Red Hat) command line and familiarity with Windows environments.
  • Solid understanding of data engineering fundamentals, including data pipelines, streaming architectures, ETL/ELT concepts, and data quality principles.
  • Familiarity with JSON, XML, CSV, and Excel data formats, parsing, and transformation.

Nice To Haves

  • Experience with streaming or messaging platforms and tools such as Kafka, JMS, Apache Flink, or Spark Streaming.
  • Experience with monitoring or observability tools such as Grafana, Prometheus, or Elasticsearch.
  • Experience with data platforms such as Snowflake.
  • Familiarity with cross-domain solutions or guards, including data diode concepts, transfer validation, and content filtering.
  • Experience enforcing encryption, authentication and authorization, and data-classification policies in partnership with security or governance teams.
  • Experience with version control tools such as Git and Agile/Scrum practices.
  • Prior experience in a government, defense, or intelligence community environment.

Responsibilities

  • Aid the team in delivering continual data feeds to users and monitor data quality and overall ingestion health.
  • Design, build, and maintain resilient real-time and near-real-time ingestion pipelines using Apache NiFi and REST APIs, including backpressure, prioritization, retries, and error-handling strategies.
  • Configure and monitor data flows across security domains using cross-domain guards or solutions, ensuring data integrity and compliance with transfer policies.
  • Parse, transform, validate, and route structured and unstructured data in formats including Excel, CSV, JSON, and XML.
  • Use data manipulation and visualization tools such as Grafana and Prometheus to communicate pipeline status, data quality, and historical trends.
  • Collaborate with platform, software, and data engineers to configure and continuously improve ingestion pipeline reliability.
  • Develop and maintain software or scripts to automate real-time feed monitoring and alert on timeliness, volume, lineage, and distribution issues.
  • Use historical pipeline data to identify and implement improvements to ingestion reliability and performance.
  • Partner with security and governance teams to enforce encryption, authentication, authorization, and data-classification requirements across pipelines and cross-domain transfers.
  • Write and maintain scripts in Python, Bash, or similar languages to automate data processing, validation, and monitoring.
  • Document data flows, system configurations, and standard operating procedures.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service