Data Engineer / Architect III USC and GC - W2 Role

Hudson Manpower•Cincinnati, OH

22h•Hybrid

About The Position

Seeking a highly skilled Data Engineer / Architect III to support enterprise-scale data integration and platform optimization initiatives focused on the Cloudera ecosystem and Apache NiFi. This role is responsible for evaluating, optimizing, modernizing, and operationalizing existing NiFi-based data integration platforms while serving as both a hands-on engineer and a technical advisor. The ideal candidate will possess strong experience with Apache NiFi, ETL/ELT pipelines, Python automation, Linux environments, and distributed systems.

Requirements

Strong hands-on Apache NiFi experience in enterprise production environments.
Highly skilled in ETL/ELT architecture and optimization.
Advanced Python scripting expertise.
Strong Linux and distributed systems knowledge.
Excellent troubleshooting and root cause analysis capabilities.
Comfortable working independently and advising technical teams.
Ability to balance architecture strategy with operational execution.
Apache NiFi (Production Environment)
Cloudera Ecosystem
ETL / ELT Development
Python Scripting & Automation
Linux Administration
Distributed Systems
Data Pipeline Optimization
Data Integration
Monitoring & Operational Support
Root Cause Analysis
Secure Data Movement & Governance

Nice To Haves

Apache Kafka
Hive
HDFS
Iceberg
CI/CD Pipelines
Cloud & Hybrid Architectures
Enterprise Data Governance
Reusable Integration Frameworks
Distributed Systems Performance Tuning

Responsibilities

Assess and optimize existing Apache NiFi and Cloudera environments, including processor configurations, queue management, flow prioritization, back pressure settings, and clustering strategies.
Improve platform scalability, reliability, and operational efficiency.
Establish reusable design standards and governance practices.
Design, develop, optimize, and support enterprise ETL/ELT pipelines, integrating data from relational databases, APIs, streaming platforms, cloud storage, and distributed file systems.
Support batch and real-time data ingestion.
Resolve pipeline failures, data latency issues, throughput bottlenecks, and operational instability.
Develop Python-based automation and transformation scripts.
Build integrations between NiFi and external systems.
Automate deployment, validation, monitoring, and operational support processes.
Support custom orchestration and processing logic.
Implement enterprise security standards including authentication, authorization, encryption, RBAC controls, and secure data movement.
Support deployment procedures and operational runbooks.
Assist with version control and CI/CD processes.
Serve as a technical advisor for platform modernization initiatives.
Document architecture recommendations, operational procedures, knowledge transfer materials, and optimization findings.
Collaborate with Data Engineers, Architects, DevOps Teams, Infrastructure Teams, Analytics Teams, and Application Teams.