Big Data Administrator Lead-I

$151,840 - $162,240/Yr

Progressive Technology Solutions Ltd - Reston, VA

Full-time - Senior

Remote - Reston, VA

Professional, Scientific, and Technical Services

About the position

The Lead Data Engineer is responsible for orchestrating, deploying, maintaining, and scaling cloud infrastructure focused on big data and platform data management, including data warehouses and data lakes. This role emphasizes high availability, reliability, automation, and performance, particularly in the context of Cloudera CDP public cloud and AWS services integration. The position requires advanced expertise in relational databases and big data systems, along with leadership in automation and system improvements.

Responsibilities

• Orchestrate, deploy, maintain, and scale cloud infrastructure for big data and platform data management.
• Prepare and manipulate data using Hadoop or equivalent technologies.
• Lead automation and improvement of components such as Solr and HBase for Cloudera CDP public cloud.
• Integrate big data systems with AWS services.
• Act as a Subject Matter Expert (SME) in relational databases and big data systems administration.
• Track and monitor projects and tasks while also performing hands-on work.

Requirements

• 10 years of experience in administration of big data and Meta Data Hub such as Cloudera.
• Advanced experience with relational databases (MySQL, PostgreSQL).
• Expertise in Cloudera Data Platform (Private and Public Cloud).
• 5 years of experience with Apache Solr, Kafka, Hive, and automation tools (Ansible, Terraform).
• 3 years of experience with public cloud solutions, specifically AWS (EC2, S3).
• Strong knowledge of UNIX and SQL.

Nice-to-haves

• Experience with Ab Initio, EMR, DynamoDB, MongoDB, RDS, DB2.
• Familiarity with DevOps practices and CI/CD pipelines.

Benefits

• Competitive hourly pay ranging from $73 to $78.
• Remote work flexibility.