Senior Data Engineers

American Express • Phoenix, AZ

1d • Hybrid

About The Position

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career.
Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express.
American Express Travel Related Services Company, Inc. seeks Senior Data Engineers to work with product teams to understand business data requirements, identify data needs and data sources to create data architecture, and support changes and implementation. Document data requirements and data stories, and maintain data models to ensure seamless integration into existing data architectures. Create and maintain information about stored data and understand database requirements and translate those requirements into physical database design. Build and enhance database design and infrastructure that supports the business portfolio. Perform database design review, support database testing, and provide production environment support for database systems and processes. Design database features for ongoing sprints and monitor database requirements based on industry trends, new technologies, known defects, and issues.
Position requires a Master’s degree in Computer Science, Engineering, Information Systems, or a related STEM field, and 2 years of big data engineering experience. Experience must include 2 years of experience with each of the following: designing and building large-scale distributed data applications using Apache Spark; developing databases and schemas on Cassandra, including data modeling for high-throughput and low-latency use cases; implementing distributed storage and retrieval using HDFS; orchestrating and scheduling workflows using Oozie; automating deployments and managing configurations using Ansible; tuning the performance of Spark jobs, Cassandra queries, and SQL workloads; conducting code reviews and managing source control using GitHub; applying Agile methodologies, including sprint planning, iterative development, and continuous delivery; using containerization and CI/CD tools, including Docker, Kubernetes, and Jenkins; applying data modeling and governance practices; developing and optimizing SQL; using Splunk for log management; applying the Spock Framework for unit testing; working with data streaming platforms, including Apache Kafka; monitoring Spark applications and infrastructure using Prometheus and Grafana; and writing shell scripts for test automation. Telecommuting is available up to 2 days per week.
Job Location: Phoenix, AZ

Requirements

• Master’s degree in Computer Science, Engineering, Information Systems, or a related STEM field
• 2 years of big data engineering experience
• 2 years of experience with designing and building large-scale distributed data applications using Apache Spark
• 2 years of experience with developing databases and schemas on Cassandra, including data modeling for high-throughput and low-latency use cases
• 2 years of experience with implementing distributed storage and retrieval using HDFS
• 2 years of experience with orchestrating and scheduling workflows using Oozie
• 2 years of experience with automating deployments and managing configurations using Ansible
• 2 years of experience with tuning the performance of Spark jobs, Cassandra queries, and SQL workloads
• 2 years of experience with conducting code reviews and managing source control using GitHub
• 2 years of experience with applying Agile methodologies, including sprint planning, iterative development, and continuous delivery
• 2 years of experience with using containerization and CI/CD tools, including Docker, Kubernetes, and Jenkins
• 2 years of experience with applying data modeling and governance practices
• 2 years of experience with developing and optimizing SQL
• 2 years of experience with using Splunk for log management
• 2 years of experience with applying the Spock Framework for unit testing
• 2 years of experience with working with data streaming platforms, including Apache Kafka
• 2 years of experience with monitoring Spark applications and infrastructure using Prometheus and Grafana
• 2 years of experience with writing shell scripts for test automation

Responsibilities

• work with product teams to understand business data requirements
• identify data needs and data sources to create data architecture, and support changes and implementation
• Document data requirements and data stories, and maintain data models to ensure seamless integration into existing data architectures
• Create and maintain information about stored data and understand database requirements and translate those requirements into physical database design
• Build and enhance database design and infrastructure that supports the business portfolio
• Perform database design review, support database testing, and provide production environment support for database systems and processes
• Design database features for ongoing sprints and monitor database requirements based on industry trends, new technologies, known defects, and issues

Benefits

• Competitive base salaries
• Bonus incentives
• 6%25 Company Match on retirement savings plan
• Free financial coaching and financial well-being support
• Comprehensive medical, dental, vision, life insurance, and disability benefits
• 20+ weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption or surrogacy
• Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
• Free and confidential counseling support through our Healthy Minds program
• Career development and training opportunities

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level