Cylake - Data Pipeline Engineer

Sagent Management•Sunnyvale, CA

1d•$150,000 - $250,000

About The Position

Join a small team building the next generation of cybersecurity products from the ground up. Led by industry veterans with a proven track record of success - you will get to architect, build, and deliver hugely impactful products with this world-class team. You will have the opportunity to grow your career and skills along with the company from the very start. Role Overview Design, build, and maintain a scalable, open-source data lakehouse architecture supporting petabyte-scale analytics workloads. Responsible for architecting end-to-end data pipelines from ingestion through transformation to consumption, ensuring high performance, reliability, and data quality.

Requirements

A proven track record of success architecting, building, and running large-scale data systems (PB scale)
Experience with both batch and real-time processing architectures
Experience with open source Data Lakehouse components, including Apache Iceberg, PostgreSQL, Neo4j, Apache Parquet, etc.
Experience with tools for stream processing and data analytics - Apache Kafka, Spark, Flink, etc.
Understanding and experience with data transformation solutions
Excellent programming experience with Python
Strong communication and documentation skills

Nice To Haves

Experience with CSP data platforms is a plus
Understanding of data lineage, quality, and governance tooling is a plus

Responsibilities

Design, build, and maintain a scalable, open-source data lakehouse architecture supporting petabyte-scale analytics workloads.
Responsible for architecting end-to-end data pipelines from ingestion through transformation to consumption, ensuring high performance, reliability, and data quality.