Senior Data Engineer II - Amex Ads, Offers, and Dining Technology

American Express•New York, NY

About The Position

The Senior Data Engineer II will lead data engineering for American Express Ads, Offers, and Dining Technology, supporting dining analytics, reporting, and downstream business applications. The role designs, develops, and implements scalable data pipelines and architecture, including reliable batch and incremental ETL/ELT workflows that ingest Rooam POS data from AWS S3 into Snowflake and transform it into analytics-ready datasets. The engineer will create and optimize Snowflake data models across staging, curated, and business-ready layers, and develop scalable processing solutions using Python, SQL, and AWS cloud services. The position emphasizes data accuracy and platform reliability through quality validation, reconciliation, monitoring, alerting, automation, CI/CD, observability, documentation, and operational excellence. It also contributes to enterprise data governance by maintaining metadata, lineage, documentation, and secure access to data assets. Working with Product, Business, Analytics, Architecture, and Engineering teams, the Senior Data Engineer II defines data requirements and delivers scalable solutions. The role leads technical design discussions, mentors engineers, promotes engineering best practices, and drives performance optimization and end-to-end delivery across enterprise-scale data engineering initiatives.

Requirements

Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related field.
At least 8 years of experience in Data Engineering, Software Engineering, or Enterprise Data Platforms.
Strong hands-on expertise in Snowflake.
Strong hands-on expertise in SQL and advanced query optimization.
Strong hands-on expertise in Python.
Experience with ETL/ELT pipeline development and orchestration.
Experience designing and implementing scalable data pipelines and cloud-based data integration solutions.
Strong understanding of data warehousing concepts, dimensional modeling, and modern data lake/lakehouse architectures.
Experience implementing data quality frameworks, reconciliation processes, schema evolution handling, and production monitoring.
Familiarity with CI/CD pipelines, Git, Infrastructure as Code, and automated deployment practices.
Excellent problem-solving, communication, stakeholder management, and cross-functional collaboration skills.
Proven ability to lead end-to-end delivery of enterprise-scale data engineering initiatives across multiple teams.

Responsibilities

Lead the design, development, and implementation of scalable data pipelines and data architecture for dining analytics, reporting, and downstream business applications.
Build and maintain reliable batch and incremental ETL/ELT workflows, including ingesting Rooam POS data from AWS S3 into Snowflake and transforming it into analytics-ready datasets.
Design and optimize Snowflake data models across staging, curated, and business-ready data layers.
Develop scalable data processing solutions using Python, SQL, and AWS cloud services, ensuring performance, reliability, and maintainability.
Implement data quality validation, reconciliation, monitoring, and alerting to ensure Rooam POS data accuracy, completeness, and timeliness.
Partner with Product, Business, Analytics, Architecture, and Engineering teams to define data requirements and deliver scalable data solutions.
Optimize Snowflake performance by tuning SQL queries, optimizing storage strategies, and managing compute resources efficiently.
Lead technical design discussions, mentor engineers, and promote engineering best practices across data engineering initiatives.
Strengthen platform reliability through automation, CI/CD, observability, documentation, and operational excellence.
Support enterprise data governance by maintaining metadata, documentation, lineage, and secure access to data assets.
Lead end-to-end delivery of enterprise-scale data engineering initiatives across multiple teams.