Data Engineer

Real Soft • Columbia, MD

5d

About The Position

We are seeking a highly experienced Data Engineer to join our team. The role involves designing, building, and maintaining robust data pipelines and systems. The ideal candidate will have a strong background in data engineering, software engineering, and cloud technologies, with a focus on ensuring data quality, performance, and reliability. This position requires U.S. Citizenship and the ability to obtain a U.S. Government Security Clearance.

Requirements

• U.S. Citizenship required.
• Candidate should be 'clearable' for a U.S. Government Security Clearance (not required at start).
• 14+ years of experience in data engineering, software engineering, or related technical fields.
• Strong experience designing and building ETL pipelines and data ingestion frameworks.
• Hands-on experience with Kafka, NiFi, and AWS (S3, SQS).
• Proficiency in Java and/or Python, with experience in unit and integration testing.
• Solid understanding of data formats (JSON, XML, SQL schemas, compressed formats).
• Experience with Kubernetes, Docker, or containerized deployments.
• Experience troubleshooting data pipelines, system performance, and dataflow issues.
• DoD 8570 IAT II certification (or higher).

Nice To Haves

• Experience supporting cyber or network operations environments.
• Familiarity with Agile development environments.
• Exposure to Apache Airflow or Mage AI.
• Strong documentation and communication skills.
• Experience developing training materials or mentoring team members.

Responsibilities

• Design and build ETL pipelines and data ingestion frameworks.
• Develop and maintain data processing systems using technologies like Kafka, NiFi, and AWS services.
• Write efficient and testable code in Java and/or Python.
• Troubleshoot data pipelines, system performance, and dataflow issues.
• Work with containerized deployments using Kubernetes and Docker.
• Ensure data quality and integrity across various data formats.
• Collaborate with team members in an Agile development environment.
• Develop training materials and mentor junior team members.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed