Senior Data Engineer

Tech Partners • Dallas, TX

6d • Onsite

About The Position

We are seeking a Senior Data Engineer to set the standard for how data pipelines are built, deployed, and run, transforming them from one-off projects into a robust platform. This role involves owning the design and governance of ELT pipelines that support analytics and reporting for a large financial services organization. It is a hands-on technical lead position where you will write code, establish best practices, review architecture, and mentor other engineers. The entire infrastructure operates on AWS and is managed through Terraform. You will be the primary point of contact for pipeline issues, Snowflake cost optimization, and new tool evaluations.

Requirements

• 7 to 8+ years of hands-on data engineering experience.
• Extensive production experience in a heavy AWS environment.
• Experience with Snowflake architecture and performance tuning at enterprise scale.
• Fivetran connector configuration, CDC, and schema evolution.
• Terraform for cloud infrastructure and Snowflake object management.
• Experience with DB2 as a source system, understanding its data extraction and potential issues.
• Production experience with dbt, including modular models, macros, tests, documentation, and version control.
• Experience with CI/CD for data pipelines.
• History of leading or mentoring engineers.
• Bachelor's degree in a data-centric field or equivalent experience.

Nice To Haves

• Kafka or other streaming experience.
• PySpark at scale.
• Azure exposure.
• Experience in banking or another regulated industry.

Responsibilities

• Build and tune Fivetran ingestion and CDC from DB2 and other sources, manage schema changes without breaking downstream models, and ensure ingestion SLAs are met.
• Structure dbt projects into staging, intermediate, and mart layers, write macros and tests for consistency, and implement lineage and documentation.
• Shape Snowflake architecture, including warehouse sizing, workload isolation, clustering, access control, secure sharing, and cost management.
• Provision Snowflake objects and AWS infrastructure using Terraform for repeatable and auditable environments.
• Own the CI/CD process for data assets, including linting, automated validation, and promotion through dev, test, and prod environments.
• Write Python, PySpark, and SQL for tasks outside of dbt, and establish coding standards for the team.
• Run proofs of concept for new tools and make decisions on their adoption.
• Collaborate with security and compliance teams to implement controls effectively.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior