Data Engineer Architect III

Hudson Manpower•Cincinnati, OH

14h

About The Position

We are seeking an experienced Data Engineer/Architect with strong expertise in Cloudera NiFi, data pipeline optimization, and ETL/ELT processes. This role involves assessing, enhancing, and supporting scalable data integration solutions.

Requirements

Hands-on experience with Cloudera NiFi in production
Strong understanding of ETL/ELT and data pipeline architecture
Proficiency in Python for scripting and automation
Experience with Linux and distributed systems
Ability to analyze and optimize existing data systems
Strong communication and documentation skills

Nice To Haves

Experience with Cloudera ecosystem (Kafka, HDFS, Hive, Iceberg)
Familiarity with CI/CD for data pipelines
Experience in monitoring and performance tuning
Exposure to cloud or hybrid data environments

Responsibilities

Evaluate existing Cloudera NiFi flows for performance, scalability, and maintainability
Identify improvements to simplify architecture and reduce operational overhead
Recommend best practices, reusable patterns, and standards
Develop and enhance ETL/ELT pipelines using NiFi
Integrate data from databases, APIs, filesystems, streaming platforms, and cloud storage
Troubleshoot pipeline failures, latency, and performance issues
Implement monitoring, error handling, and recovery mechanisms
Use Python for data transformation, automation, and scripting
Build integrations between NiFi and external systems
Ensure secure data movement with authentication, authorization, and encryption
Support deployment, versioning, and operational processes
Align platform changes with compliance and operational standards
Act as a technical advisor to data and platform teams
Document findings, recommendations, and improvements
Provide knowledge transfer and long-term support guidance