Data Engineer 1

Flashpoint

1d•$107,500 - $150,000

About The Position

Flashpoint is looking for a Data Engineer I to own the real-time data infrastructure behind our intelligence platform, the Pub/Sub topics, Dataflow pipelines, and AI enrichment that let our customers spot threats the moment they emerge. This is a depth role, not a learning role. You're joining a small, senior team where the architecture is already solid and proven; your job is to be its operational heartbeat, keeping petabyte-scale pipelines flowing 24/7/365, troubleshooting under pressure, and continuously hardening the systems our customers depend on.

Requirements

Operated production streaming pipelines at real scale, Pub/Sub, Kafka, or similar, and you know how message queues actually behave when traffic spikes and consumers fall behind.
Debugged and optimized GCP Dataflow (or comparable Beam-based) jobs in production, not just stood them up.
Been first responder for systems with no tolerance for downtime, and you've owned the incident from page to postmortem.
Built the monitoring and alerting that catches failures before customers do, using tools like Prometheus, Grafana, or Stackdriver.
Integrated LLMs into a data pipeline, Vertex AI and Gemini, or strong transferable work with similar platforms, and understand prompt engineering in a data context.
Worked terabyte-to-petabyte datasets and kept systems responsive while filtering high-volume data.
Hands-on production experience building or operating streaming data pipelines (Pub/Sub, Kafka, or similar).
Demonstrated ability to debug and optimize GCP Dataflow (or comparable Beam-based stream processing).
A reliability mindset, fluency with SLAs, observability, on-call, and incident response, and the autonomy to dive into logs, metrics, and traces unaided.
Proficiency with Python, SQL, and Linux.
Real experience integrating Vertex AI / Gemini, or strong transferable experience with similar LLM platforms, into data workflows.

Nice To Haves

BigQuery, BigTable, Cloud Storage, Cloud Functions
Terraform
data quality / validation frameworks
threat intelligence or security data workflows
experience on small, senior teams

Responsibilities

Own end-to-end operations of real-time pipelines that ingest, enrich, filter, and route data through Vertex AI and Gemini for risk assessment.
Own our Pub/Sub infrastructure end to end: message delivery, consumer groups, and the production incident response when something goes sideways.
Scale, monitor, and optimize Dataflow streaming and batch jobs processing petabytes of data, diagnosing failures and shipping the fix.
Build and maintain the monitoring, alerting, and incident-response tooling for systems that can't go down.
Safeguard data integrity end to end, ensuring data reaches customers accurately and on time.
Partner with Product, the broader Data team, and Intelligence Analysts to turn requirements into operational reality.