Airflow Data Engineer

American Express • Phoenix, AZ

240d • $85,000 - $150,000

About The Position

As part of our diverse tech team, you can architect, code and ship software that makes us an essential part of our customers' digital lives. Here, you can work alongside versatile engineers in an open, supportive, inclusive environment where your voice is valued, and you make your own decisions on what tech to use to solve challenging problems. Amex offers a range of opportunities to work with the latest technologies and encourages you to back the broader engineering community through open source. And because we understand the importance of keeping your skills current and relevant, we give you dedicated time to invest in your professional development. Find your place in technology on #TeamAmex. Cloud Engineering provides a comprehensive platform that enables business critical applications to have Faster Time-to-Market for American Express. Cloud Engineering offers dynamic rapid code-to-development models and services such as Platform-as-a-Service, Infrastructure-as-a-Service, DB-as-a-Service, Analytics-as-a-Service, Messaging-as-a-Service, CICD Pipelines, etc. for application developers in a hybrid cloud environment. American Express is building an exciting Hybrid Cloud platform and is in search of innovative and critical thinking engineers to build our Hybrid Cloud Platform environment. This position will report into the xPaaS Services Enterprise Cloud Engineering team within the Enterprise Cloud Engineering organization. In this Engineer role, you will be part of a versatile team responsible for building scalable, secure, and highly available Enterprise Astronomer Airflow in Private and Public cloud providers.

Requirements

• Overall 5+ years of Technology relevant experience with 2-3 Years of relevant engineering experience.
• Strong experience in Advanced Apache Airflow orchestration and optimization.
• Data pipeline design and implementation.
• Python programming and scripting expertise.
• SQL and NoSQL database management.
• Data modeling and ETL processes.
• Continuous integration and deployment (CI/CD).
• Real-time data streaming and processing.
• A knowledge of integration with public cloud managed services in AWS/GCP/Azure.
• Demonstrated working knowledge of high availability and Disaster Recovery implementations.
• Bachelor's degree in computer science, Computer Engineering or equivalent work experience.
• Strong Passion for learning new technologies, particularly in the cloud computing infrastructure area.

Nice To Haves

• Private or Public Cloud management and administration.
• Validated diagnostic and service restoration skills.
• Excellent interpersonal and customer service skills.
• Strong English communication skills with the ability to work with customers in critical outage situations.
• Good written and verbal communication and presentation skills.

Responsibilities

• Design and implement scalable data pipelines using Apache Airflow.
• Optimize Airflow DAGs for performance and resource efficiency.
• Collaborate with data scientists to integrate machine learning models into workflows.
• Develop custom Airflow operators and plugins to extend functionality.
• Monitor and troubleshoot Airflow jobs to ensure reliability and uptime.
• Participate in agile sprints to deliver iterative improvements to data infrastructure.
• Mentor junior engineers on best practices in Airflow and data engineering.
• Implement CI/CD pipelines for automated deployment of Airflow configurations.
• Stay updated with the latest Airflow features and industry trends.
• Collaborate with cross-functional teams to align data workflows with business goals.

Benefits

• Competitive base salaries.
• Bonus incentives.
• 6% Company Match on retirement savings plan.
• Free financial coaching and financial well-being support.
• Comprehensive medical, dental, vision, life insurance, and disability benefits.
• Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need.
• 20+ weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption or surrogacy.
• Free access to global on-site wellness centers staffed with nurses and doctors (depending on location).
• Free and confidential counseling support through our Healthy Minds program.
• Career development and training opportunities.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: Credit Intermediation and Related Activities
• Education Level: Bachelor's degree