Senior Engineering Manager, Data Processing Platform
About The Position
Horizon3.ai is seeking a Senior Engineering Manager to lead the Data Processing Platform team. This team is responsible for transforming raw pentest telemetry into actionable findings, reports, and insights for customers. The role involves leading a significant architectural change, migrating the pentest data processing from a batch system to a real-time, event-driven microservice architecture. This initiative aims to enhance scalability, handling hundreds of thousands of hosts and streaming findings as they are discovered, thereby reducing insight delivery time from weeks to hours. The work requires a blend of platform engineering for infrastructure and cybersecurity domain understanding to translate existing business logic into real-time processing capabilities.
Requirements
- Experience managing backend, data, or platform engineering teams, with a track record of shipping through the team.
- Solid fundamentals in backend and distributed systems: data modeling, API design, queues/streams, and the tradeoffs between batch and streaming.
- Comfort with modern cloud infrastructure (AWS preferred), containers, and observability tooling (Datadog or similar).
- Ability to lead through technical ambiguity — you can facilitate a design discussion, help the team converge, and know when to dig in yourself.
- Clear written communication: you can put together a roadmap, a design doc, or a postmortem the rest of the company can read.
- A sense of ownership for how the team operates day-to-day, not just what it ships.
Nice To Haves
- Exposure to event-driven architectures or streaming platforms (Kafka, Pulsar, Kinesis, Flink, or similar).
- Background in cybersecurity, pentesting, or vulnerability management.
- Familiarity with Python and/or Go.
Responsibilities
- Lead and grow a team of backend and platform engineers migrating post-op processing from a batch system to a real-time, event-driven architecture.
- Partner with Product, Attack Engineering, and adjacent Platform teams to sequence the rework so customer value ships continuously rather than as one big-bang cutover.
- Work with senior engineers on the team to shape the technical direction: event streaming, stream processing, storage, schema evolution, and replayable processing.
- Invest in operational excellence — SLOs, observability, on-call, and incident response — as this system becomes central to every pentest Horizon3 runs.
- Help translate existing batch-era logic (finding enrichment, attack path analysis, reporting) into streaming-friendly designs without regressing fidelity.
- Recruit, mentor, and retain engineers who care about both distributed systems craft and the security domain.
- Establish healthy team practices: design reviews, technical writing, clear API contracts with neighboring teams, and durable decision records.
Benefits
- health, vision & dental insurance for you and your family
- a flexible vacation policy
- generous parental leave
- equity package in the form of stock options
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Manager
Education Level
No Education Listed
