Senior Collections Data Engineer (US-Remote)

iCOUNTER • Sacramento, CA

6d • $140,000 - $180,000 • Remote

About The Position

iCOUNTER is seeking a Senior Software Engineer / Data Engineer to join its Threat Intelligence Collections team. The role designs, builds, and operates large-scale systems that collect, enrich, and deliver high-fidelity threat intelligence from open-web, deep-web, and dark-web sources, including anonymity networks. It combines cybersecurity, data engineering, and AI-driven automation.

The engineer owns the lifecycle of threat data pipelines, from raw source ingestion through transformation into clean, structured, queryable intelligence used for detection, hunting, and response. The position also develops agentic workflows, operates high-scale media pipelines, and builds APIs for downstream security teams and platforms. The primary language for data engineering and automation is Python. The role works closely with threat intelligence analysts, detection engineers, and security researchers, and continuously improves collection performance, data quality, latency, and coverage.

Requirements

• At least 5 years of experience as a Software Engineer or Data Engineer, focused on large-scale data collection and processing.
• Deep experience collecting data at scale from open- and dark-web sources, including scraping, crawling, API integration, Tor-based collection, and anti-detection or anti-bot techniques.
• Strong expertise building and operating data pipelines using Airflow, Dagster, Prefect, Spark, Kafka, Flink, or equivalent tools.
• Advanced data-parsing skills, including converting messy, unstructured web data into structured intelligence.
• Expert-level Python proficiency, including asynchronous programming, concurrency, and performance optimization.
• Hands-on experience designing and implementing agentic workflows with frameworks such as LangChain, CrewAI, AutoGen, LlamaIndex, or similar, and integrating LLMs into production data systems.
• A track record of building and maintaining production APIs using FastAPI, Flask, or similar.
• Strong understanding of cybersecurity concepts and threat intelligence data types, including IOCs, TTPs, malware samples, phishing kits, and underground forums.
• Comfort working in a fast-paced, ambiguous environment with high-stakes data quality requirements.

Nice To Haves

• Experience with cloud platforms.
• Knowledge of modern data stack tools such as dbt, Snowflake, ClickHouse, or DuckDB.
• Familiarity with containerization, including Docker and Kubernetes, and infrastructure-as-code.
• Prior work in cybersecurity, threat intelligence, or intelligence collection organizations.
• Contributions to open-source tools or public research in threat intelligence or data collection.

Responsibilities

• Design and scale high-volume data collection systems for open-web, deep-web, and dark-web sources, including Tor, I2P, and other anonymity networks.
• Build and maintain fault-tolerant batch and streaming pipelines for ingestion, transformation, enrichment, and storage.
• Develop parsing and normalization logic for unstructured, semi-structured, and evolving threat data.
• Design, build, and maintain autonomous, LLM-powered agentic workflows for multi-step collection and enrichment tasks.
• Architect and operate media pipelines for ingesting, processing, storing, and enriching images, videos, screenshots, documents, and other collected content.
• Design and build internal and external APIs that expose intelligence to downstream security teams and platforms.
• Write production-grade Python for data engineering and automation.
• Collaborate with threat intelligence analysts, detection engineers, and security researchers to translate intelligence requirements into reliable data systems.
• Monitor, troubleshoot, and optimize collection performance, data quality, and latency.
• Stay current with threat actor tactics, techniques, procedures, data sources, and evasion techniques to improve collection coverage.

Benefits

• Full health, dental, and vision coverage, with 100% of employee premiums and 90% of dependent premiums covered on base plans.
• 401(k), HSA, and FSA plans.
• Flexible PTO.
• Meaningful equity ownership.
• Company holidays and paid sick days.
• Monthly home-office stipend for internet, equipment, or other technology needs.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed