Senior Data Engineer

Futurae

9d•Hybrid

About The Position

As a Data Engineer at Futurae, you will build and scale the data backbone that powers our real-time security insights. This is a pivotal role for a hands-on expert who thrives on technical execution and data integrity. In this role, you will drive the development and maintenance of our data infrastructure. You will bridge the gap between raw event data and actionable intelligence, building high-throughput pipelines and robust APIs that serve our engineering and ML teams. Your mission is to ensure that streaming and batch data move seamlessly from ingestion to storage, providing our teams with reliable, high-quality data they can trust for critical security decisions.

Requirements

Minimum 4+ years building, operating, and maintaining modern data pipelines.
Expert-level Apache Beam and Dataflow (PySpark is a plus) or similar tools.
Deep experience with BigQuery and Bigtable or similar tools.
Strong proficiency in FastAPI and asynchronous programming.
Comfort with linting and automated testing, such as Ruff and Pytest.
You love digging into the "how" and "why" of complex systems.
You don't wait for a ticket to improve the system.
You take full ownership of the data lifecycle and communicate clearly in a remote setting.

Responsibilities

Build and scale high-throughput streaming pipelines using Apache Beam and Dataflow.
Optimize data flows into BigQuery and Bigtable for speed and reliability.
Develop and maintain Python-based data APIs (FastAPI) for internal services.
Actively look for ways to make our data systems faster, more reliable, and easier to use.
Dig deep into complex data anomalies to find and solve root causes.
Partner with ML/Product teams to build practical, usable data schemas.
Maintain a high bar for production Python code using Poetry, Ruff, and pytest.