Automation Data Integration Engineer
About The Position
UltraViolet Cyber is seeking an Automation Data Integration Engineer to support DHS in Washington, D.C. This role is crucial for enhancing the efficiency and effectiveness of DHS's cybersecurity operations by designing and implementing automated solutions. The engineer will collaborate with cybersecurity professionals, data analysts, and system owners in a dynamic environment to reduce manual effort and improve risk visibility, directly contributing to safeguarding DHS's mission-critical systems and data. The position involves maintaining cybersecurity automations, connectors, data pipelines, and dashboards. Key responsibilities include creating and managing end-to-end pipelines for ingesting data from diverse sources (APIs, databases, IoT) and delivering it to data warehouses or lakes, automating ETL/ELT processes, and implementing automated tests, anomaly detection, and real-time alerts to ensure data integrity.
Requirements
- U.S. Citizenship required with Active Secret Security Clearance
- DHS EOD suitability or Current DHS or DHS EOD preferred
- BS/BA + 8 years of applicable experience in data integration and automation
- Demonstrated expertise in Apache Airflow, Prefect, or similar orchestration tools
- Experience with ETL/ELT processes and automation tools
- Knowledge of data quality frameworks and observability systems
- Experience with APIs, databases, and data warehouse/lake technologies
- Strong programming skills in Python, SQL, or similar languages
Nice To Haves
- Previous DHS or DoD experience with classified systems
- Experience with Infrastructure as Code (IaC) tools (Terraform, CloudFormation)
- Knowledge of data catalog and metadata management solutions
- Experience with CI/CD pipelines (Jenkins, GitLab, GitHub Actions)
- Familiarity with cloud platforms (AWS, Azure, GCP)
- Cloud security experience with AWS, Azure, or other platforms
Responsibilities
- Design and maintain cybersecurity automations, connectors, data pipelines, and dashboards that reduce manual effort and improve risk visibility across tools and workflows.
- Perform Data Pipeline Automation by creating and managing end-to-end pipelines that ingest data from diverse sources (APIs, databases, IoT) and deliver it to data warehouses or lakes.
- Perform ETL/ELT Optimization by automating the extraction, transformation, and loading process to ensure data is clean, standardized, and ready for analysis.
- Perform Data Quality & Observability by implementing automated tests, anomaly detection, and real-time alerts to validate data integrity and identify issues.
- Perform Workflow Orchestration by scheduling and managing dependencies for data jobs using tools like Apache Airflow or Prefect.
- Perform System Reliability & Maintenance by building self-healing pipelines that can automatically retry failed tasks and scale resources based on demand.
- Perform Data Cleansing & Validation by running automated scripts to detect data anomalies, impute missing values, or mask sensitive information.
- Perform CI/CD Integration by implementing continuous integration and deployment for data pipelines.
Benefits
- 401(k), including an employer match of 100% of the first 3% contributed and 50% of the next 2% contributed
- Medical, Dental, and Vision Insurance (available on the 1st day of the month following your first day of employment)
- Group Term Life, Short-Term Disability, Long-Term Disability
- Voluntary Life, Hospital Indemnity, Accident, and/or Critical Illness
- Participation in the Discretionary Time Off (DTO) Program
- 11 Paid Holidays Annually
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
