Data Engineer (Data Architecture & Engineering)

Maania Consultancy Services • Washington, DC

2d

About The Position

This role focuses on Data Architecture & Engineering, requiring expertise in handling large-scale data processing using distributed computing frameworks and cloud environments like AWS. The Data Engineer will work with various datastores, utilize Python and related libraries, and leverage software platforms such as Docker and Kubernetes. Familiarity with Linux/Unix servers, Agile methodologies, and collaboration tools is essential. The position also involves publishing design reports and coordinating with team members to meet project goals.

Requirements

• Active TS/SCI clearance
• Bachelor’s degree or equivalent practical experience.
• Familiarity working with Amazon Web Managed Services (AWS) or any other cloud environments.
• Working experience with datastores like PostgreSQL, S3, Redshift, MongoDB/DynamoDB, Redis, Elasticsearch/OpenSearch and SQL.
• Proficient utilizing Python with key libraries like pandas and PySark, NiFi, Airflow, AWS Lambda or similar technologies.
• Working knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS and Kafka.
• Familiar with Linux/Unix server environments.
• Experience with Agile development methodology.
• Working knowledge with Collaboration tools, such as, Jira and Confluence

Nice To Haves

• Master’s degree or equivalent experience in a related field.
• Familiarity and experience with the Intelligence Community (IC), and the intel cycle.
• Familiarity and experience with the Department of Homeland Security (DHS).
• Direct Experience with DHS and Intelligence Community (IC) component's data architectures and environments (IC-GovCloud experience preferred).
• Experience with cloud message APIs and usage of push notifications.
• Keen interest in learning and using the latest software tools, methods, and technologies to solve real world problem sets vital to national security.
• Working knowledge with public keys and digital certificates.
• Experience with DevOps environments.
• Expertise in various COTS, GOTS, and open source tools which support development of data integration and visualization applications.
• Specialization in Object Oriented Programming languages, scripting, and databases

Responsibilities

• Expertise in distributed computing frameworks to handle large-scale data processing.
• Publishing and/or presenting design reports.
• Coordinating with other team members to reach project milestones and deadlines.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level