Senior Big Data Engineer

S&P Global • New York, NY

18h

About The Position

Our enterprise data management team is at the forefront of designing and developing cutting-edge data solutions that drive strategic business outcomes across the organization. We value quick learners who thrive in a dynamic technology environment and can seamlessly transition between collaborative teamwork and independent problem-solving. The team fosters a culture of continuous learning and innovation, where members tackle emerging technologies while maintaining strong analytical rigor and effective cross-functional communication.

Requirements

• 6+ years of hands-on experience in technology application development and production support
• 5+ years of experience developing data pipelines that extract, transform, and load data using programming languages such as Python, Scala, or Java
• Minimum 3+ years of experience developing and supporting ETL processes using cloud-based analytics platforms (such as Databricks, Snowflake, or Azure Synapse)
• Experience building data-intensive applications using modern programming technologies (including but not limited to C#, Java, Python, Scala, and SQL)
• Proficiency with cloud computing environments (such as AWS, Azure, or Google Cloud Platform)

Nice To Haves

• Experience with stream processing technologies (such as Apache Kafka, Apache Pulsar, or Amazon Kinesis) for real-time data processing
• Hands-on experience with distributed processing frameworks (such as Apache Spark, Dask, or Hadoop MapReduce) for large-scale data analytics
• Knowledge of data integration tools (such as Apache NiFi, Talend, or Informatica) and database replication technologies
• Experience with CI/CD pipelines, containerization technologies (such as Docker, Podman, or containerd), and orchestration platforms (such as Kubernetes, Docker Swarm, or OpenShift)

Responsibilities

• Design and develop scalable data processing pipelines using distributed computing frameworks to handle large-scale enterprise datasets
• Build and maintain ETL processes that extract, transform, and load data into strategic information products supporting organizational goals
• Develop data-intensive applications and services using modern programming languages and cloud-based analytics platforms
• Implement stream processing solutions using real-time data processing technologies to support business-critical operations
• Collaborate with cross-functional teams to translate complex business requirements into robust technical solutions
• Provide production support and troubleshooting for data systems, ensuring high availability and performance

Benefits

• Health care coverage designed for the mind and body.
• Generous time off helps keep you energized for your time on.
• Access a wealth of resources to grow your career and learn valuable new skills.
• Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
• It’s not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
• From retail discounts to referral incentive awards—small perks can make a big difference.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed