Big Data Platform Engineer

VSG Business Solutions • Jersey City, NJ

20h • Onsite

About The Position

The Big Data Platform Engineer will administer, configure, size, tune, and troubleshoot big data platform technologies, with particular emphasis on Spark, HDFS, and Kafka. The role requires Linux administration skills, including logging in and running commands, as well as strong communication skills. The position is onsite four days per week in Jersey City, New Jersey. Cloudera Hadoop/CDP and Cloudera Manager experience is preferred, but is not the primary skill requirement.

Requirements

• 3–5 years of hands-on administration, configuration, and sizing experience with Cloudera Cluster, HDFS, Spark, and Kafka.
• Strong, demonstrable expertise in Spark administration, configuration, performance tuning, and troubleshooting.
• Strong, demonstrable expertise in HDFS administration, storage management, security, performance, and troubleshooting.
• Strong, demonstrable expertise in Kafka administration, topic management, producer/consumer architecture, performance, security, and troubleshooting.
• Linux administration skills, including the ability to log in and perform commands.
• Great communication skills.

Nice To Haves

• Experience with Cloudera Hadoop/CDP and Cloudera Manager.

Responsibilities

• Administer, configure, size, and troubleshoot Spark environments, including performance tuning.
• Administer HDFS, including storage management, security, performance, and troubleshooting.
• Administer Kafka, including topic management, producer/consumer architecture, performance, security, and troubleshooting.
• Log in to Linux systems and perform commands.
• Use enterprise monitoring and operational tools such as Grafana and Splunk.

What This Job Offers

• Job Type: Full-time
• Education Level: No Education Listed