Sr. Data Engineer

Edgewater Federal Solutions, Inc.

5d•Onsite

About The Position

Edgewater Federal Solutions is seeking a Sr. Data Engineer to join their team in Washington, D.C. This position is onsite only and candidates must live in a 50-mile radius to the work location. Edgewater Federal Solutions is a privately held government contracting firm located in Frederick, MD, founded in 2002. The company was founded with the vision of being highly recognized and admired for supporting customer missions through employee empowerment, exceptional services and timely delivery. Edgewater Federal Solutions is ISO 9001, 20000-1, 270001 certified, appraised at CMMI Level 3 Maturity for Development and Services, and has been named in the Top Workplaces in the Greater Washington Area Small Companies for 2018 through 2025. It has been and continues to be the policy of Edgewater Federal Solutions to provide equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, marital status, veteran status, and/or other statuses protected by applicable law.

Requirements

Proficiency in developing, maintaining, monitoring, and the long-term operations of data pipelines or processing systems running in Cloudera Data Platform.
Understanding of data extraction, transformation, loading, and performance tuning of solutions utilizing multiple streams of input data code-based, git and DevOps-enabled technologies using Python or SQL such as PySpark, pandas, or dbt
5+ years of experience in application/data development (i.e., Python)
5+ years of experience with data integration/ingestion tools (i.e., Apache NiFi)
Advanced level knowledge of SQL, Java, Microsoft SQL Server, distributed data/computing platforms (i.e., Apache NiFi, Hadoop, MapReduce, Hive, HBase, Kafka, Spark)
Experience with Scrum and Kanban methodologies
Experience with UNIX/Linux including basic commands and shell scripting
Experience in implementing and maintaining continuous integration continuous delivery (CI/CD) pipelines and data platform management

Responsibilities

Participates in the planning and execution of policies, practices, and projects that acquire, control, protect, and enhance the value of data assets.
Facilitates obtaining data from a variety of different sources, in the right formats, assuring that it adheres to data quality standards, as well as resolving any information flow and content issues.
Builds a robust data pipeline that cleans, transforms, and aggregates unorganized data into databases.