Senior Data / Java Engineer

American Express • Phoenix, AZ

471d • $110,000 - $190,000

About The Position

The Senior Data / Java Engineer at American Express is responsible for designing and developing data engineering solutions within a big data ecosystem. This role involves hands-on coding, debugging, and documentation, while collaborating closely with the Site Reliability Engineering (SRE) team. The engineer will also focus on building a modern loyalty platform, enhancing customer engagement, and transitioning from legacy systems to a microservices-based architecture.

Requirements

• Master's in computer applications or equivalent OR bachelor's degree in engineering or computer science or equivalent.
• Deep understanding of Hadoop and Spark Architecture and its working principles.
• Deep understanding of Data warehousing concepts.
• Ability to design and develop optimized Data pipelines for batch and real-time data processing.
• 5+ years of software development experience.
• 5+ years' experience on Python or Java with hands-on experience in writing and understanding complex SQL (Hive/PySpark).
• 3+ years of hands-on experience with Map-Reduce, Hive, Spark (core, SQL, and PySpark).
• Hands-on experience with Google Cloud Platform (BigQuery, DataProc, Cloud Composer).
• 3+ years of experience in UNIX shell scripting.
• Experience in analysis, design, development, testing, and implementation of system applications.
• Ability to effectively communicate with internal and external business partners.

Nice To Haves

• Understanding of Distributed ecosystem.
• Experience in designing and building solutions using Kafka streams or queues.
• Experience with NoSQL databases such as HBase, Cassandra, Couchbase, or MongoDB.
• Experience with Data Visualization tools like Tableau, SiSense, Looker.
• Ability to learn and apply new programming concepts.
• Knowledge of Financial reporting ecosystem will be a plus.
• Experience in leading teams of engineers and scrum teams.

Responsibilities

• Design Data Engineering solutions on big data ecosystem.
• Develop custom applications and modify existing applications to meet business requirements.
• Perform hands-on coding, debugging, and documentation.
• Work closely with the SRE team to provide post-implementation support.
• Translate user needs into system architecture and assess application performance.
• Test the engineering resilience of software and automation tools.
• Identify innovative ideas and proof of concept to meet customer needs.
• Collaborate with other development teams, testing, and production support to ensure smooth transitions throughout the development life cycle.

Benefits

• Competitive base salaries
• Bonus incentives
• 6% Company Match on retirement savings plan
• Free financial coaching and financial well-being support
• Comprehensive medical, dental, vision, life insurance, and disability benefits
• Flexible working model with hybrid, onsite or virtual arrangements depending on role and business need
• 20+ weeks paid parental leave for all parents, regardless of gender, offered for pregnancy, adoption or surrogacy
• Free access to global on-site wellness centers staffed with nurses and doctors (depending on location)
• Free and confidential counseling support through our Healthy Minds program
• Career development and training opportunities

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Industry: Credit Intermediation and Related Activities
• Education Level: Bachelor's degree