Data Platform Engineer, VP II - State Street Investment Management

State Street • Boston, MA

9h

About The Position

State Street Investment Management’s Data, Analytics & AI Services (DAAIS) team is seeking an experienced Vice President – Technology Lead to lead the architecture, engineering execution, modernization strategy, and technology roadmap supporting the investment management business. This role is accountable for the architecture, engineering delivery, and operational excellence of modern data platform and software capabilities that enable the investment management business. The successful candidate will bring deep hands-on expertise in large-scale data platform architecture, distributed computing, data pipeline engineering, and modern cloud architecture.

Requirements

• Master’s degree in Computer Science or a related engineering discipline.
• 15+ years of technology experience in the financial services industry.
• Strong hands-on programming in Python and SQL (Java/Scala a plus), with the ability to design, debug, and optimize distributed data processing; familiarity with AI-assisted development tools (e.g., GitHub Copilot, Codex, Anthropic tools).
• Deep experience with Spark (batch and streaming) including performance tuning, troubleshooting, and cost-aware optimization.
• Hands-on experience building and operating modern Lakehouse platforms using Snowflake and Databricks on AWS (Azure acceptable), supporting high concurrency analytical workloads.
• Working knowledge of open table formats and metadata ecosystems, including Apache Iceberg and table catalogs/governance services (e.g., Unity Catalog or equivalent).
• Demonstrated hands-on experience designing and implementing modern, open architecture data platforms supporting OLAP, OLTP, and near real-time workloads; familiarity with catalog services that enable multiple compute engines, high concurrency, and strong performance.
• Extensive hands-on experience architecting and implementing enterprise DevOps and CI/CD pipelines with cloud-agnostic solutions across public cloud providers (e.g., AWS, GCP, Azure).
• Expertise in zero-copy data sharing, data virtualization, catalog federation, and governed data access patterns, enabling scalable and trusted data consumption across platforms.
• Experience working with both unstructured data sources and processing patterns
• Strong operational and engineering excellence mindset, with experience establishing SDLC standards, CI/CD, observability, reliability engineering, incident management, and continuous improvement practices for mission-critical platforms.

Nice To Haves

• Previous experience in data/platform development within a financial institution.
• Experience with both structured and unstructured data management tools and associated patterns
• Familiarity with modern governance frameworks (Unity Catalog, Collibra, Alation).
• Expertise in AI-assisted coding using GitHub Copilot or Claude Code Assistant.

Responsibilities

• Execute the long-term vision, target architecture, and roadmap for a unified, cloud-native data platform spanning ingestion, transformation, storage, governance, and secure access at scale.
• Collaborate with enterprise and application architects to define data strategies and deliver logical/physical data models aligned to analytical workloads.
• Collaborate on the core platform capabilities (Lakehouse, batch, events, streaming, metadata/catalog, observability, and security), ensuring reliability, scalability, and operability.
• Design, implement, and optimize Iceberg-based tables (partitioning, compaction, metadata) for consistent, performant analytical access across multiple compute engines.
• Establish data engineering excellence: CI/CD, IaC (Terraform/CloudFormation), automated testing, schema/versioning practices, data quality controls, and end-to-end observability.
• Partner with Product, Analytics, ML, and domain SMEs to define data semantics and data product contracts (schemas, SLAs, documentation, versioning/backward compatibility), and to enforce governance, stewardship, and compliance standards.
• Build and publish curated semantic layer models (serving models/marts), exposing governed BI endpoints and/or consumption APIs to ensure consistent metrics and business definitions.
• Optimize pipeline and query performance through effective partitioning/clustering, caching, archiving, and data lifecycle (purge/retention) patterns.
• Evaluate and advance the use of agentic AI frameworks to improve software delivery across the full software development life cycle (SDLC).

Benefits

• our retirement savings plan (401K) with company match
• insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages
• paid-time off including vacation, sick leave, short term disability, and family care responsibilities
• access to our Employee Assistance Program
• incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans)
• eligibility for certain tax advantaged savings plans
• inclusive development opportunities
• flexible work-life support
• paid volunteer days
• vibrant employee networks

What This Job Offers

• Job Type: Full-time
• Career Level: Manager