Data Engineer

OpenDataJobs • Washington, DC

40d • Hybrid

About The Position

Peregrine Advisors is a firm founded on a simple conviction: the best solutions come from the people closest to the problem, given real ownership and the tools to deliver. We are a data and technology innovation hub and a Benefit Corporation working at the center of the federal government's mission to deliver for client stakeholders and the US public, looking for highly motivated contributors who thrive when trusted to own a hard problem and equipped to deliver the solution. Your first assignment is to build the pipelines that move a federal agency's data from source to warehouse on Amazon Web Services (AWS): ingest, process, store, and keep it clean and trustworthy at scale. The work is real, hard, and it matters. It is also where you start, not the shape of your career here: we hire people, not seats, and we move our best to where the hardest problems are.

Requirements

• Hands-on data engineering on AWS: Spark ETL (Glue, EMR), Python and PySpark, and S3 data-lake design feeding a warehouse.
• The reliability craft around it: event orchestration, data quality and lineage, monitoring, and infrastructure-as-code.
• The judgment to build in a regulated environment where accuracy and auditability are not optional.
• U.S. citizenship (this initial engagement may be staffed by U.S. citizens only) and the ability to obtain a Public Trust determination.

Responsibilities

• Build pipelines that move a federal agency's data from source to warehouse on Amazon Web Services (AWS): ingest, process, store, and keep it clean and trustworthy at scale.
• Ingest-process-store pipelines on AWS: Spark-based extract, transform, and load (ETL) with Glue, Amazon EMR, Lambda, and Step Functions, in Python and PySpark.
• Build a data lake that feeds the warehouse: S3 design (Parquet, partitioning, lifecycle) into Redshift, with event orchestration, secrets and monitoring, and data quality, validation, and lineage built in.
• In time, build new capabilities, tools, and lines of business for the firm.

Benefits

• Fully paid medical, dental, and vision
• a matched 401(k) with immediate vesting
• unlimited paid time off
• sponsored certifications

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed