Senior Data Engineer (Flink)

SSC HR Solutions

4d

About The Position

Builds and runs real time streaming pipelines, keeping latency low and jobs recoverable at high volume. Monitors pipeline health and handles recovery when jobs fail.

Requirements

• Strong hands on Apache Flink across DataStream API and Flink SQL.
• Event time processing, checkpointing, savepoints, and state management in production.
• High volume Kafka streaming.
• Apache Flink (DataStream, Flink SQL), Kafka, Java, Scala, Python, SQL, Docker, Kubernetes
• Strong hands-on experience with Apache Flink, including DataStream API and Flink SQL.
• Experience with high-volume Kafka streaming and real-time data processing.
• Strong knowledge of event time processing, checkpointing, savepoints, and state management.
• Experience with data modelling for analytics and streaming into a lakehouse.
• Experience monitoring pipeline health and handling job recovery and failures.

Nice To Haves

• Apache Iceberg or other open table formats.
• Airflow.
• On premises or self managed cluster experience.

Responsibilities

• Builds and runs real time streaming pipelines, keeping latency low and jobs recoverable at high volume.
• Monitors pipeline health and handles recovery when jobs fail.
• Data modelling for analytics and streaming into a lakehouse.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed