Sr. Data Engineer ( SQL / Big data / Hadoop )
Redolent•Sunnyvale, CA
•Onsite
About The Position
We have the following urgent role with our DIRECT client. This is a Sr. Data Engineer position requiring advanced SQL, experience with large datasets and distributed computing technologies like Hadoop, Hive, and Spark. The role also involves Unix/Linux scripting, ETL processes, and real-time data ingestion using Kafka.
Requirements
- Advanced SQL (preferably Teradata)
- Experience working with large data sets
- Experience working with distributed computing (MapReduce, Hadoop, Hive, Pig, Apache Spark, etc.)
- Strong Hadoop scripting skills
- Experience in Unix/Linux shell scripting or similar programming/scripting knowledge
- Experience in ETL/ processes
- Real time data ingestion (Kafka)
Nice To Haves
- Development experience with Java, Scala, Flume, Python
- Cassandra
- Automic scheduler
- R/R studio, SAS experience a plus
Responsibilities
- Work with large data sets
- Process petabytes of data using Hadoop scripting
- Develop and implement ETL processes
- Perform real-time data ingestion using Kafka
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
