Sr. Big Data Engineer

Redolent • Sunnyvale, CA

3d • Onsite

About The Position

As part of the International eCommerce Data Engineering team, you'll be responsible for design, development and operations of large-scale data systems operating at petabytes scale. You will be focusing on real-time data pipelines, streaming analytics, distributed big data and machine learning infrastructure. You'll interact with the engineers, product managers, BI developers and architects to provide scalable robust technical solutions.

Requirements

• Min 6-8 years of Big data development experience
• Demonstrates up-to-date expertise in Data Engineering, complex data pipeline development
• Experience with Java, Python to write data pipelines and data processing layers
• Experience in writing map-reduce jobs
• Demonstrates expertise in writing complex, highly-optimized queries across large data sets
• Proven, working expertise with Big Data Technologies Hadoop, Hive, Kafka, Presto, Spark, just to name a few
• Highly Proficient in SQL
• Experience with Cloud Technologies ( GCP, Azure)

Nice To Haves

• Experience with Relational, NoSQL/in memory data stores would be a big plus ( Oracle, Cassandra, Druid)
• Retail experience is huge plus

Responsibilities

• Design, develop, implement and tune large-scale distributed systems and pipelines that process large volume of data; focusing on scalability, low -latency, and fault-tolerance in every system built.
• Provides and supports the implementation and operations of the data pipelines and analytical solutions
• Performance tuning experience of systems working with large data sets
• Experience with clickstream data processing
• Experience with Data Governance ( Data Quality, Metadata Management, Security, etc.)
• Experience in developing RESTful API data service

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed