Hadoop Engineer (SME)

MSP • Chicago, IL

3d • Onsite

About The Position

Genesis10 is seeking a Hadoop Engineer (SME) for a contract position with a Global Financial Institution in Chicago, IL. This is an 12+ month contract opportunity. This role supports NextGen Platforms built around Big Data Technologies like Hadoop, Spark, and Kafka. The Hadoop Engineer will be involved in the full life cycle of an application as part of an agile development process, with a focus on cluster management of vendor-based products like Cloudera and Databricks. The ideal candidate will interact with clients, development teams, and vendors at a high technical level.

Requirements

• Strong knowledge of Hadoop Architecture, HDFS, Hadoop Cluster and Hadoop Administrator's role
• Intimate knowledge of fully integrated AD/Kerberos authentication
• Experience setting up optimum cluster configurations and debugging knowledge of YARN
• Hands-on with analyzing various Hadoop log files, compression, encoding, and file formats
• Expert level knowledge of Cloudera Hadoop components such as HDFS, Sentry, HBase, Kafka, Impala, SOLR, Hue, Spark, Hive, YARN, Zookeeper and Postgres
• Strong technical knowledge of Unix/Linux, Databases (Sybase/SQL/Oracle), and scripting (Java, Python, Perl, Shell)
• Experience with Monitoring, Alerting, and Job Scheduling Systems
• Strong grasp of automation/DevOps tools such as Ansible, Jenkins, SVN, and Bitbucket
• Experience working on Big Data Technologies including Hadoop, Kafka, and Spark

Nice To Haves

• Cloudera Admin / Dev Certification
• Certification in Cloud, Docker-Container, or OpenShift Technologies

Responsibilities

• Work on complex, major or highly visible tasks in support of multiple projects that require multiple areas of expertise
• Provide subject matter expertise in managing Hadoop and Data Science Platform operations with a focus on Cloudera Hadoop, Jupyter Notebook, OpenShift, Docker-Container Cluster Management and Administration
• Integrate solutions with other applications and platforms outside the framework
• Manage platform operations across all environments which includes upgrades, bug fixes, deployments, metrics/monitoring for resolution and forecasting, disaster recovery, and incident/problem/capacity management
• Serve as a liaison between client partners and vendors in coordination with project managers to provide technical solutions that address user needs

Benefits

• Access to hundreds of clients, most who have been working with Genesis10 for 5-20+ years.
• The opportunity to have a career-home in Genesis10; many of our consultants have been working exclusively with Genesis10 for years.
• Access to an experienced, caring recruiting team (more than 7 years of experience, on average.)
• Behavioral Health Platform
• Medical, Dental, Vision
• Health Savings Account
• Voluntary Hospital Indemnity (Critical Illness & Accident)
• Voluntary Term Life Insurance
• 401K
• Sick Pay (for applicable states/municipalities)
• Commuter Benefits (Dallas, NYC, SF, and Illinois)

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed