Sr. Director, Software Engineering – Data Platform & MDM Integration

S&P Global•New York, NY
•$185,000 - $265,000

About The Position

The Sr. Director, Software Engineering leads data platform and Master Data Management (MDM) integration for S&P Dow Jones Indices. The role is part of a team central to the division’s data strategy, data transformation, and replacement of legacy technical debt, working collaboratively with product and business partners. The position leads integration between the Databricks lakehouse and NeoXam MDM platform to support large-scale index-linked investment products. It advances cloud data architecture using Databricks capabilities, applies AI/ML and agentic approaches to automate data conversion and quality processes, and leads multiple teams of product-focused software and data engineers. The role also directs legacy modernization and migration to AWS, including breaking monolithic applications into microservices, while promoting engineering excellence and scalable, resilient solutions.

Requirements

  • At least 9 years of experience in software engineering and data platform development, with a track record in enterprise-scale solutions.
  • At least 7 years of people-management experience leading technical teams and supporting organizational growth in fast-paced environments.
  • Advanced expertise in cloud data platforms such as Databricks, Snowflake, or similar, including hands-on experience with data lakehouse architectures and ETL/ELT processes.
  • Strong experience with cloud infrastructure, including AWS services such as S3, EMR, Glue, and Lambda, or equivalent Azure or GCP services.
  • Proven leadership in large-scale data migrations and system modernization, including management of complex technical transformations.

Nice To Haves

  • Master’s degree in Computer Science, Software Engineering, or a related technical discipline, with 13 or more years of progressive software development and data architecture experience.
  • Deep expertise in MDM platforms such as NeoXam, Informatica MDM, or IBM InfoSphere, with successful enterprise data platform integration experience.
  • Advanced AI/ML and Generative AI experience, including machine learning frameworks such as MLflow, Kubeflow, or SageMaker and LLM implementation tools such as LangChain or Hugging Face.
  • Extensive experience with big-data technologies and distributed computing frameworks such as Apache Spark, Hadoop, or Flink, and modern data processing architectures.
  • Bachelor’s degree in Computer Science, Engineering, or a related technical field.

Responsibilities

  • Lead and oversee high-volume integration between the Databricks lakehouse and NeoXam MDM platform.
  • Establish foundational data architecture for index-linked investment products.
  • Use Databricks capabilities, including Unity Catalog, Delta Live Tables, and Serverless compute, to optimize data pipelines and performance.
  • Implement Databricks Mosaic AI and agentic frameworks to automate data transformation, quality assurance, and anomaly detection across the conversion lifecycle.
  • Lead, manage, and grow multiple teams of software and data engineers, mentoring their professional and technical development.
  • Direct migration of legacy assets and terabytes of data to the AWS cloud ecosystem.
  • Modernize legacy systems by breaking monolithic applications into microservice architectures.
  • Promote adoption of new technologies, continuous improvement in software engineering practices, and delivery of scalable, resilient solutions.

Benefits

  • Health care coverage for physical and mental wellness.
  • Generous time off.
  • Learning and career-development resources.
  • Competitive pay and retirement planning.
  • Continuing education program with a company-matched student loan contribution.
  • Financial wellness programs.
  • Family-focused benefits and perks.
  • Retail discounts.
  • Referral incentive awards.
  • Annual incentive plan.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service