Data Engineer (114)

Delan Associates • Brooklyn, NY

4d

About The Position

This role focuses on improving operational and reporting data processes and infrastructure, with a specific emphasis on government or community organizing contexts. The Data Engineer will be responsible for processing, cleaning, manipulating, managing, and analyzing large datasets, and building pipelines to automate these steps. A key aspect of the role involves working within complex, highly secure government network environments and leveraging various data tools and platforms.

Requirements

• A minimum of 3 years of experience with the following skill sets:
• 1+ years working in government, or in community, issue, labor, or political organizing
• Experience using one or more of the following data processing, analysis, and visualization tools in a professional setting: SQL (Postgres, MSSQL, DuckDB), Python, R, GIS, Tableau, Looker Data Studio, Excel/Google Sheets (advanced)
• Experience using one or more of the following tools/frameworks to implement and support data engineering, transformation, and orchestration/automation: dbt and dbt-duckdb, Dagster, DLT, Docker, Ducklake (S3 Postgres), git and GitHub, Sling
• Experience using 1+ of the following platforms: NGP VAN, Salesforce, Hustle, Mobilize and Reach
• Proficiency in working with complex enterprise network environments in highly secure government ecosystems, including differentiating between public and private networks, working within the confines of private networks, managing TLS/SSL and termination, configuring data egress/ingress through forward and reverse proxies.
• Experience processing, cleaning, manipulating, managing, and analyzing large datasets and building pipelines to automate these steps, preferably in an AWS environment with tools such as EC2, ECR, Farget, IAM, Lambda functions, Redshift, S3 buckets, and VPC and private subnetting
• Experience conducting entity resolution and record linkage (i.e., deduplication) using probabilistic frameworks like Splink.
• Strong written and oral communication skills in English

Nice To Haves

• A demonstrated interest in public service and improving the lives of New Yorkers
• Eagerness to take initiative, ask questions, learn new skills, and solve problems in a fast-paced, mission-driven environment

Responsibilities

• Improve operational and reporting data processes and infrastructure.
• Process, clean, manipulate, manage, and analyze large datasets.
• Build pipelines to automate data processing, cleaning, manipulation, management, and analysis.
• Implement and support data engineering, transformation, and orchestration/automation using specified tools/frameworks.
• Work with complex enterprise network environments in highly secure government ecosystems.
• Conduct entity resolution and record linkage (deduplication) using probabilistic frameworks.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed