Big Data Engineer Lead

S&P Global • New York, NY

1d • Onsite

About The Position

You will be an expert contributor within the Ratings Organization's Data Services Team. Our team brings deep expertise across critical Ratings data domains, AI/ML and Generative AI solutions, technology platforms, and architectural patterns. Through collaboration, innovation, and knowledge sharing, we help drive a unified strategy and deliver scalable solutions that create business value. Data Services team members play a key role in providing technical leadership, fostering innovation, and delivering impactful solutions. This is a unique opportunity to contribute to and help shape the next generation of S&P Ratings' analytics platform.

Requirements

• Experience building AI, machine learning, or data-driven solutions in cloud environments such as AWS.
• Strong Python programming skills with experience using machine learning frameworks such as TensorFlow, PyTorch, or scikit-learn.
• Hands-on experience developing applications with Java and Spring Boot.
• Experience working with containerized and virtualized environments, including Docker, Kubernetes, and virtual machines.
• Familiarity with modern AI-assisted development tools such as Cursor, Claude Code, GitHub Copilot, or similar platforms.
• Experience using version control systems such as Git.
• Strong knowledge of SQL and experience working with structured and unstructured datasets.
• Understanding of machine learning concepts, including deep learning, natural language processing, and generative AI.
• Experience building or working with AI agents, autonomous workflows, or agentic AI frameworks.

Nice To Haves

• Experience with AI frameworks such as LangChain, LangGraph, CrewAI, ADK, Strands, or similar technologies.
• Experience with graph technologies and graph-based algorithms.
• Familiarity with front-end technologies such as React, JavaScript, HTML, or comparable frameworks.
• Experience in data engineering, data preparation, and feature engineering.
• Experience working with data lakes, AI-ready data platforms, or large-scale data ecosystems.
• Experience building machine learning solutions using distributed computing frameworks such as Apache Spark, Hadoop, or similar technologies.
• Knowledge of modern AI-native software development lifecycle (SDLC) practices.

Responsibilities

• Partner with business stakeholders to gather requirements, define use cases, and plan solution delivery.
• Collaborate with data scientists and software engineers to design, build, and deploy scalable machine learning and generative AI solutions.
• Analyze large datasets and develop data-driven insights to improve business outcomes.
• Build platforms, services, and tooling to optimize, evaluate, and fine-tune machine learning models for performance and scalability.
• Research and apply emerging AI and machine learning technologies to enhance existing solutions and drive innovation.
• Work closely with cross-functional teams to deliver high-quality, reliable solutions in a fast-paced environment.
• Contribute to the development of best practices, technical standards, and reusable AI capabilities across the organization.

Benefits

• Health care coverage designed for the mind and body.
• Generous time off helps keep you energized for your time on.
• Access a wealth of resources to grow your career and learn valuable new skills.
• Competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
• Perks for your partners and little ones, too, with some best-in class benefits for families.
• Retail discounts to referral incentive awards.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed