Senior Data Engineer - ETL & Pipelines (Remote)

2am.tech

1d • Remote

About The Position

Our client operates a high-volume B2C creator platform in the entertainment industry, serving more than 200,000 active users and 30,000 creators, with payment events flowing through the platform every second. Data is one of the company’s most valuable competitive advantages. In this role, you will work closely with an experienced data analyst to transform a continuous flow of events into clean, reliable, and query-ready data that supports product, payments, and growth decisions. The Role We are looking for a Data Engineer who will take end-to-end ownership of the company’s ETL pipelines - the systems responsible for moving data from the transactional platform, including MongoDB, payment streams, and behavioral events, into the analytics environment where it can be turned into actionable insights. This is not simply a dashboard integration role. You will design and maintain pipelines that remain accurate, reliable, and timely while millions of events are processed and financial transactions occur every second. Data integrity is critical. A missing payment event or duplicated transaction is not merely a technical issue—it can have a direct financial impact.

Requirements

• Approximately 5–10 years of relevant engineering experience
• Strong experience with batch and/or streaming data pipelines
• Deep knowledge of event-driven architectures and message queues
• A strong understanding of idempotency, at-least-once versus exactly-once processing, retries, and out-of-order event delivery
• Professional experience with TypeScript and Node.js
• Solid SQL and data-modeling capabilities
• The ability to collaborate with analysts and design schemas that make business queries efficient and intuitive
• A strong focus on data integrity, particularly when working with payments and financial transactions
• Experience implementing reconciliation, auditing, monitoring, and data-quality controls
• Previous experience in a high-volume B2C environment such as gaming, gambling, fintech, payments, or another real-money platform

Nice To Haves

• Experience working with payment or transaction data and financial reconciliation
• Experience with MongoDB change streams or change data capture
• Familiarity with data warehouse tooling and dbt-style modeling
• Experience working with Kubernetes and infrastructure as code
• Experience with .NET or C#

Responsibilities

• Design, build, and maintain ETL and streaming pipelines that ingest high-volume event and payment data and deliver it to the analytics warehouse reliably and accurately.
• Partner closely with the Lead Data Analyst to create warehouse schemas that answer essential business questions related to creator earnings, payment throughput, retention, lifetime value, and cohort behavior.
• Build idempotent, replayable, and observable jobs that can withstand traffic spikes, retries, and partial failures without compromising downstream data.
• Move data through queue infrastructure including BullMQ and Redis, AWS SQS, and RabbitMQ, while instrumenting pipelines through OpenTelemetry.
• Implement reconciliation checks, deduplication, backfills, and reliable handling of late or out-of-order events.
• Collaborate with payments and platform teams to ensure that every transaction is captured once, accurately, and on time.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed