Senior Data Pipeline Engineer

Serviss • Arlington, VA

16h • Hybrid

About The Position

SERVISS is seeking a Senior Data Pipeline Engineer to join an established, mission-critical Pipeline team on the DHS CDM Data Services / BETSIE Program. In this senior role, you will take a leading technical role in the data ingestion and pipeline function that collects asset and cyber-intelligence data from SaaS platforms, primarily Armis and Axonius, and delivers it into Elasticsearch to power a unified single-pane-of-glass dashboard for agency stakeholders. Our customer’s requirements are dynamic and complex. The ideal candidate can engage resources and work across teams to decompose large, complex problems into workable solutions, set technical direction, and mentor junior engineers. An aptitude for strategic planning and the ability to communicate effectively at all levels of the organization are a must. The successful candidate will also serve as a liaison for the customer’s data-improvement efforts, participating in regular meetings, representing the program, and supporting the requirements-gathering process.

Requirements

• US citizenship with the ability to obtain Public Trust Suitability
• Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field (master's degree preferred)
• A minimum of six years of experience designing, implementing, and managing the technical delivery of large-scale data engineering or data pipeline services to diverse organizations
• 4+ years hands-on with Elasticsearch or OpenSearch: index design, mappings, ingest pipelines, query/aggregation, and cluster performance tuning
• Strong experience integrating REST APIs from SaaS platforms, including authentication, pagination, rate limiting, incremental ingestion, and resilient error handling
• Proficiency with a scripting/pipeline language (Python strongly preferred) and with ETL/ELT tooling such as Logstash, Elastic Agent/Beats, or equivalent
• Experience designing, implementing, and managing data schemas that comply with cyber-relevant data standards and frameworks, e.g., SCAP, STIX, OTEL, Elastic Common Schema, and Splunk Common Information Model
• Knowledge of data transformation processes and experience documenting and maintaining data lineage, especially traceability of transformed data to source data
• Solid data modeling and normalization skills for heterogeneous sources, including mapping to a common schema
• Knowledge of Federal Cybersecurity and Risk Management policies and practices, including FISMA; NIST SP 800-37, 800-53, 800-30, and 800-39; and FedRAMP
• Solid understanding of Git, version control workflows, and CI/CD

Nice To Haves

• Direct experience integrating Armis and/or Axonius, or comparable CAASM / asset-intelligence platforms (e.g., Tenable, Qualys, ServiceNow)
• Experience utilizing data cataloging and governance tools (e.g., Alation, Collibra)
• Containerization and orchestration (Docker, Kubernetes) and infrastructure-as-code (Terraform, Ansible)
• CI/CD tooling (GitLab CI, Jenkins) and DevSecOps practices in cloud (AWS GovCloud / Azure Government a plus)
• Experience with monitoring/observability tooling and data-reconciliation frameworks
• Knowledge of cybersecurity tools and technologies
• Active DHS Public Trust or prior EOD
• Familiarity with Agile / SCRUM methodologies
• Strong problem-solving and analytical skills, with a sense of urgency and the ability to prioritize and balance multiple tasks

Responsibilities

• Architect, automate, and maintain scalable, fault-tolerant data processing pipelines that ingest asset, vulnerability, and configuration data from Armis, Axonius, and other SaaS/API sources into Elasticsearch
• Handle high-volume, high-velocity data collection, processing, and indexing to support near-real-time visibility
• Design Elasticsearch index strategies, mappings, ingest pipelines, and transforms; normalize disparate source data to a common schema (e.g., Elastic Common Schema) for consistent search, correlation, and reporting
• Build and maintain Kibana dashboards and visualizations that deliver a true single-pane-of-glass view of the agency's technical posture
• Own API integration patterns against evolving vendor APIs, including authentication and token management, pagination, rate limiting, incremental/delta ingestion, and resilient error handling and retry logic
• Implement automated reconciliation and data-quality checks to ensure ingested data is complete, consistent, and accurate against source systems; document and maintain data lineage and traceability of transformed data back to source
• Manage index lifecycle (ILM), retention, sharding, and cluster performance tuning for high-volume, low-latency operations
• Instrument pipelines with monitoring, alerting, and logging so data-flow issues are detected and resolved before they reach stakeholders
• Follow programming best practices, emphasizing code reusability and highly automated CI/CD pipelines for scalability
• Serve as a leading technical resource for the data ingestion and pipeline function on the DHS CDM Data Services / BETSIE Program
• Set technical direction and decompose large, complex problems into workable solutions across teams
• Establish and enforce data governance, validation, and documentation standards; review designs and mentor junior engineers on the team
• Serve as a liaison for the customer's data-improvement efforts, participating in regular meetings, representing the program, and supporting requirements gathering
• Communicate complex data and pipeline concepts to non-technical audiences, translating them into actionable recommendations

Benefits

• Highly competitive compensation and best in class benefits
• 100% of medical, vision, dental, and life insurance premiums paid for by SERVISS
• Be part of an exciting company with ground floor opportunities in the Equity Participation Program
• Opportunities for annual performance bonuses and growth incentives
• 401(k) retirement plan with 6% dollar for dollar match

What This Job Offers

• Job Type: Full-time
• Career Level: Senior