Senior Data Pipeline Engineer

Candid•,

5h•$100,000 - $130,000•Remote

About The Position

Candid is a nonprofit providing data and insights about the social sector. The Senior Data Pipeline Engineer is a senior technical role responsible for the day-to-day development and delivery of Candid’s data pipelines. The role combines SQL and ETL engineering expertise with hands-on work across modern cloud data platforms to design, build, and tune reliable pipelines that move data from source systems into Candid’s data warehouse and lakehouse. This is a remote position with a 35-hour work week, Monday through Friday. In-person attendance is expected twice per year at annual weeklong all-staff summits. Staff outside the NYC area are expected to travel for these meetings. Applicants must be legally authorized to work in the United States without employer sponsorship, now or in the future. The salary range is $100,000–$130,000 for the NYC area and will be adjusted for other localities; skills and experience are also considered.

Requirements

At least 5 years of experience in database engineering, data engineering, or ETL development, with demonstrated ownership of production data pipelines.
Expert-level Transact-SQL skills, including stored procedures, views, and indexing.
Hands-on C#/.NET development experience.
Proven experience architecting ETL processes with SSIS.
Experience with AWS and open table formats such as Apache Iceberg and Parquet.
Strong data quality and root-cause troubleshooting skills, including experience resolving production data incidents.
Familiarity with source control, CI/CD, and release/deployment processes across Dev/QA/Prod environments.
Ability to mentor and review other engineers’ work.
Excellent written and verbal communication.
Good business judgment, independent prioritization, and ability to work well in a distributed team.
Willingness to perform other duties and special projects as needed or requested.
Sensitivity and respect for racial, gender, sexual orientation, and cultural differences.
Commitment to Candid’s values: driven, direct, accessible, curious, and inclusive.
Legally authorized to work in the United States without employer sponsorship, now or in the future.

Nice To Haves

Experience with orchestration platforms such as Apache Airflow.
Experience with AWS Lambda, DynamoDB, and Trino/Starburst.

Responsibilities

Architect, develop, and maintain ETL/ELT and C#/.NET pipeline services, including SSIS, Airflow, AWS Lambda, enhancer, and message-processing services, to move data reliably from source systems into Candid’s warehouse and lakehouse.
Support Candid’s evolving cloud data platform, including Iceberg ingestion and transformation pipelines, DynamoDB, and query performance tuning via Trino/Starburst.
Monitor end-to-end data quality; investigate production pipeline issues to find root causes, document findings, and drive fixes through reprocessing.
Scope and onboard new external and regulatory data sources end-to-end, and contribute to schema and architecture decisions while coordinating changes across ingestion and transformation layers.
Maintain SOPs and technical documentation, mentor and review Associate-level engineers’ work, and participate in the team’s release and deployment process.
Partner with the Data Operations Manager on architecture and roadmap decisions, and provide escalation-level support for mission-critical pipeline issues, including after-hours as needed.
Perform other duties and special projects as needed or requested.

Benefits

Health insurance, including medical, dental, and vision coverage.
Retirement contribution with an additional option for a match.
Paid life insurance and AD&D.
Paid leave time, including PTO, compassionate leave, volunteer leave, holidays, and parental leave.
Short-term and long-term disability.
Pre-tax transit benefits.
Flexible spending accounts.
Supplemental insurance.
Summer hours.
Eligible employer for the Public Service Loan Forgiveness (PSLF) program.