About The Position

The Sr. Director, Software Engineering will lead strategic data-platform and MDM integration work for S&P Dow Jones Indices. The role oversees high-volume integration between the Databricks lakehouse and NeoXam MDM platform, building foundational data architecture for index-linked investment products. It also advances cloud data architecture using Databricks capabilities, applies AI/ML and agentic frameworks to automate data transformation and quality processes, and leads teams of software and data engineers. The position will spearhead modernization of legacy infrastructure, including migration of legacy assets and terabytes of data to AWS and decomposition of monolithic applications into microservices. The role promotes engineering excellence, technology adoption, continuous improvement, and the delivery of scalable, resilient solutions. The team collaborates with product and business partners to support the division's data strategy and replace legacy technical debt.

Requirements

  • At least 9 years of experience in software engineering and data platform development, with a track record in enterprise-scale solutions.
  • At least 7 years of people-management experience leading technical teams and driving organizational growth in fast-paced environments.
  • Advanced expertise in cloud data platforms such as Databricks, Snowflake, or similar, including hands-on experience with data lakehouse architectures and ETL/ELT processes.
  • Strong experience with cloud infrastructure, including AWS services such as S3, EMR, Glue, and Lambda, or equivalent cloud platforms such as Azure or GCP.
  • Proven leadership in large-scale data migrations and system-modernization initiatives, including managing complex technical transformations.

Nice To Haves

  • Master's degree in Computer Science, Software Engineering, or a related technical discipline, with 13+ years of progressive software development and data architecture experience.
  • Deep expertise in MDM platforms such as NeoXam, Informatica MDM, or IBM InfoSphere, with success integrating enterprise data platforms.
  • Advanced AI/ML and Generative AI experience, including hands-on work with ML frameworks such as MLflow, Kubeflow, or SageMaker and LLM implementation using LangChain, Hugging Face, or similar platforms.
  • Extensive experience with big-data technologies, including distributed computing frameworks such as Apache Spark, Hadoop, or Flink and modern data-processing architectures.
  • Bachelor's degree in Computer Science, Engineering, or a related technical field.

Responsibilities

  • Lead strategic MDM integration initiatives, architecting and overseeing high-volume data integration between the Databricks lakehouse and NeoXam MDM platform.
  • Establish foundational data architecture for index-linked investment products.
  • Use Databricks features, including Unity Catalog, Delta Live Tables, and Serverless compute, to optimize data pipelines and performance.
  • Implement Databricks Mosaic AI and agentic frameworks to automate data transformation, quality assurance, and anomaly detection across the conversion lifecycle.
  • Lead, manage, and grow multiple teams of product-focused software and data engineers, and mentor their professional and technical development.
  • Lead migration of legacy assets and terabytes of data to a modern AWS cloud ecosystem.
  • Modernize monolithic applications by breaking them into microservice architectures.
  • Champion technology adoption, continuous improvement of software engineering practices, and delivery of scalable, resilient solutions.

Benefits

  • Health care coverage designed for physical and mental wellness.
  • Generous time off.
  • Access to learning resources and career-development opportunities.
  • Competitive pay and retirement planning.
  • Continuing education program with a company-matched student-loan contribution.
  • Financial wellness programs.
  • Family benefits and perks.
  • Retail discounts.
  • Referral incentive awards.
  • Annual incentive plan eligibility.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service