Senior Software Engineer - Hadoop Infrastructure

Bloomberg•New York, NY

5d•$160,000 - $240,000

About The Position

Bloomberg's Hadoop Infrastructure team provides multi-tenant, observable, and highly available infrastructure based on open-source Apache Hadoop, including HDFS, HBase, and YARN. The team supports large-scale data applications across Bloomberg and manages clusters spanning tens of petabytes of storage, thousands of servers, hundreds of billions of requests per day, tens of thousands of jobs, and hundreds of thousands of tables. It also provides methodologies and domain expertise on Hadoop services to applications across Bloomberg's product domains. The Senior Software Engineer will help advance how tenants use Hadoop Infrastructure, improve migration and support capabilities for Bloomberg's large data and compute footprint, and make secure interactions with infrastructure frameworks more usable. The role also focuses on improving the usability, reliability, and scalability of open-source Apache Hadoop services for Bloomberg application teams. The position is based in New York.

Requirements

At least 4 years of demonstrated experience working with an object-oriented programming language, specifically Java, and associated technologies such as Spring, JMX, or JDBC.
A degree in Computer Science, Engineering, or a similar field, or equivalent work experience.
At least 3 years of experience in the Hadoop ecosystem and related technologies, including HBase, HDFS, and YARN.
Knowledge of modern development methodologies and tools such as Jenkins, Maven, and Jira.
Solid understanding of the Linux operating system, shell scripting, and operating-system troubleshooting.
Strong problem-solving and communication skills.

Nice To Haves

Experience working with open-source software or communities.
Experience with distributed-systems architecture and system design.
Knowledge of Ansible.
Experience with workflow automation tools such as Airflow or Argo.

Responsibilities

Advance how tenants from multiple product domains use Hadoop Infrastructure services to meet their goals.
Provide and improve capabilities to migrate and support a massive data and compute footprint to newer versions.
Improve tenants' user experience when securely interacting with underlying infrastructure frameworks.
Understand and improve the usability, reliability, and scalability of open-source Apache Hadoop services to optimize them for Bloomberg application teams.