Data Platform Engineer

EXL•United States,

1d•$110,000 - $130,000•Hybrid

About The Position

We are seeking a data platform engineer who will be responsible for designing, deploying, automating, and supporting enterprise data platform infrastructure built on Cloudera Data Platform (CDP). The role emphasizes platform reliability, automation, and operational excellence by leveraging Ansible to provision, configure, patch, and manage large-scale Hadoop and cloud-based data environments. Working closely with infrastructure, security, DevOps, and data engineering teams, the engineer ensures the platform remains secure, highly available, scalable, and optimized to support critical financial data processing and analytics workloads.

Requirements

Strong experience in SQL and data modeling
Experience with workflow orchestration tools like Airflow
Good understanding of ETL/ELT processes and data pipeline architecture
Cloudera Data Platform (CDP) and Cloudera Manager
Ansible automation, playbook development, and configuration management
Linux system administration (RHEL/CentOS)
Hadoop ecosystem components (HDFS, YARN, Hive, Impala, Spark, Solr, Kafka, Oozie)
Shell scripting (Bash) and Python
Git, Jenkins, and CI/CD pipelines
Monitoring tools such as Prometheus, Grafana, or Splunk
Networking, DNS, load balancing, and storage concepts
Strong problem-solving and analytical skills
Excellent Communication skills
Ability to effectively collaborate with global stakeholders and teams

Nice To Haves

Familiarity with cloud platforms (AWS/Azure/GCP) is a plus
Cassandra (docker) knowledge is a plus.
AI knowledge will be welcomed
Experience in fintech and banking would also count

Responsibilities

Deploy, administer, and maintain Cloudera Data Platform (CDP) clusters across development, testing, and production environments.
Automate infrastructure provisioning, software installation, configuration management, and patching using Ansible playbooks and roles.
Monitor platform health, troubleshoot performance issues, and optimize Hadoop ecosystem services.
Perform cluster upgrades, capacity planning, disaster recovery testing, and lifecycle management.
Implement security controls including Kerberos, LDAP/Active Directory integration, TLS, and role-based access control.
Collaborate with data engineering and application teams to support ingestion, processing, and analytics workloads.
Develop operational automation and CI/CD workflows to improve platform efficiency and reduce manual effort.
Maintain system documentation, standard operating procedures, and automation artifacts.
Ensure platform compliance with enterprise security, governance, and regulatory standards.
Participate in 24 hrs on-call support in rotation (secondary and primary Pager duty).