Senior Data Pipeline Engineer

CACI•Linthicum, MD

1d•Onsite

About The Position

Join our dynamic team as we revolutionize enterprise security with our Secure the Enterprise initiative. We are seeking a skilled professional to help us transition from a manual system security evaluation and authorization process to a cutting-edge model that leverages automation, streamlined processes, continuous monitoring, and comprehensive network data gathering. This role offers an exciting opportunity to make a significant impact on our organization's security posture and operational efficiency.

Requirements

Active TS/SCI w/ Polygraph
12 years minimum experience with a high school diploma/GED.
10 years minimum experience with an Associate’s Degree.
8 years minimum experience with a Bachelor’s degree.
6 years minimum experience with a Master’s degree.
4 years minimum experience with a Doctorate’s degree.
All experience and education must be in a technical field directly related to the labor category and obtained from accredited institutions.
Experience with Centos7 or RedHat8.
Proven experience administering a NiFi cluster.
Experience with Docker.
Experience with Terraform.
Hands-on experience designing, implementing, and troubleshooting dataflows using Apache NiFi.
Strong understanding of leveraging NiFi Expression Language for dynamic dataflows.
Experience with tools like Amazon S3, MongoDB, Apache Spark, and Elasticsearch.
Knowledge of NiFi cluster architecture and performance tuning strategies.
Expertise in deploying and managing NiFi in cloud environments.
Proficiency in scripting languages like Python, Groovy, or Bash.

Nice To Haves

Experience in cloud hosting and automation.
Experience working in an Agile environment.

Responsibilities

Seamlessly integrate data with tools such as Amazon S3, MongoDB, Apache Spark, and Elasticsearch.
Enhance NiFi cluster architecture, performance tuning, and data pipeline strategies.
Design, implement, and troubleshoot dataflows using Apache NiFi, including processors, connections, and templates.
Deploy and manage NiFi in cloud environments (AWS, Azure, GCP) and utilize cloud-native tools for data processing.
Oversee continuous integration, environment configuration, and deployment while supporting project compliance and security.
Focus on delivering automation solutions that enable other teams to operate more efficiently.
Experience tracking work through JIRA workflows.