ME00559-Data Engineer

Momentum Engineering, Inc.•Washington, DC

102d

About The Position

Seeking a data engineer to work in a variety of settings to develop and design data pipelines to support end-to-end solutions. The candidate will build systems that collect, manage, and convert raw data into usable information for multiple purposes, including but not limited to, IT application usage, reporting, and applicant processing.

Requirements

Must have active Top Secret/SCI clearance
Bachelor’s degree or equivalent practical experience
Expertise in distributed computing frameworks to handle large-scale data processing
Familiarity working with Amazon Web Managed Services (AWS) or any other cloud environments
Working experience with datastores like PostgreSQL, S3, Redshift, MongoDB/DynamoDB, Redis, Elasticsearch/OpenSearch and SQL
Proficient utilizing Python with key libraries like pandas and PySark, NiFi, Airflow, AWS Lambda or similar technologies
Working knowledge with software platforms and services, such as, Docker, Kubernetes, JMS/SQS, SNS and Kafka
Familiar with Linux/Unix server environments
Experience with Agile development methodology
Publishing and/or presenting design reports
Coordinating with other team members to reach project milestones and deadlines
Working knowledge with Collaboration tools, such as, Jira and Confluence

Nice To Haves

Master’s degree or equivalent experience in a related field
Familiarity and experience with the Intelligence Community (IC), and the intel cycle
Familiarity and experience with the Department of Homeland Security (DHS)
Direct Experience with DHS and Intelligence Community (IC) component's data architectures and environments (IC-GovCloud experience preferred)
Experience with cloud message APIs and usage of push notifications
Keen interest in learning and using the latest software tools, methods, and technologies to solve real world problem sets vital to national security
Working knowledge with public keys and digital certificates
Experience with DevOps environments
Expertise in various COTS, GOTS, and open source tools which support development of data integration and visualization applications
Experience with cloud message APIs and usage of push notifications
Specialization in Object Oriented Programming languages, scripting, and databases

Responsibilities

Identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
Develop and design data pipelines to support an end-to-end solution
Develop and maintain artifacts (e.g. schemas, data dictionaries, and transforms related to ETL processes)
Integrate data pipelines with AWS cloud services to extract meaningful insights
Work with stakeholders to support their data infrastructure needs and assist with data-related technical issues
Design and develop robust and functional dataflows to support raw data and expected data
Provide Tier 3 technical support for deployed applications and dataflows
Define and communicate a clear product vision for our client’s software products, aligning with user needs and business objectives
Create and manage product roadmaps that reflect both innovation and growth strategies
Partner with a government product owner and a product team of 7-8 FTEs
Collaborate with the rest of data engineering team to design and launch new features
Coordinate and document dataflows, capabilities, etc.
Occasionally (as needed) support to off-hours deployment such as evening or weekends