Principal Data Engineer

Fidelity Investments•Westlake, TX

About The Position

Designs and implements highly scalable, reusable cloud-based data management and reporting platform components. Develops data models, reports, and visualizations for business intelligence, using AI-assisted development tools for data pipeline development. Evolves foundational cloud data platform patterns to support increased data volumes, concurrent usage, and cross-region consumption for global markets. Develops reusable metrics frameworks and reporting models, and architects data-lake consumption patterns for batch, near-real-time, and high-performance reporting workloads. Builds CI/CD pipelines supporting complex deployments, versioned data assets, and environment-specific configurations. Defines technical standards and best practices, resolves complex pipeline and reporting issues, optimizes cloud platforms for performance, reliability, and cost efficiency, and contributes to architectural decisions. The role also designs and develops database, pipeline, and integration solutions for analytics and web applications, including solutions for financial advisors. It independently implements data integrations across cloud-based and traditional infrastructure, delivers transformed data for customer use, and supports configuration management, testing, version control, static analysis, end-to-end development, documentation, SIT and UAT planning, release coordination, and production readiness. The engineer partners with product owners, analysts, and engineers; participates in architecture and product discussions; develops advanced data engineering frameworks; advises senior leadership; provides data extracts to stakeholders; mentors less-experienced engineers; and performs complex technical and functional analysis for multiple initiatives. The position requires either a bachelor's degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign equivalent) and five years of relevant experience, or a master's degree in one of those fields (or foreign equivalent) and three years of relevant experience. The experience must involve building financial and Medicare data warehouse applications using data modeling and ETL processing. Fidelity will not provide immigration sponsorship for this position.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and five years of experience as a Principal Data Engineer or in a closely related occupation building financial and Medicare data warehouse applications using data modeling and ETL processing; alternatively, a relevant master’s degree (or foreign equivalent) and three years of such experience.
  • Demonstrated expertise designing and delivering enterprise data pipelines and building scalable solutions with Python and Apache NiFi.
  • Experience integrating Snowflake and PostgreSQL, including stored procedures, and implementing API-driven ingestion using JSON and JOLT.
  • Experience establishing CI/CD pipelines using DevOps and Groovy and executing cloud-native workloads on AWS, including EC2, S3, Lambda, Secrets Manager, and CloudFormation.
  • Experience supporting data quality and reliability using iCEDQ and PyFlowX, and enabling analytics through Dataverse, Power BI semantic modeling, and PowerApps.
  • Experience ensuring auditability and operational visibility and using AI-assisted development tools for delivery and troubleshooting, including AI techniques for data quality, anomaly detection, schema evolution, and metadata governance.
  • Demonstrated expertise implementing enterprise-scale ETL, data integration, and business analytics solutions in FinTech and healthcare (Medicare) data domains.
  • Experience building and optimizing IBM DataStage ETL workflows with UNIX Shell scripting and integrating mainframe files, flat files, and relational databases, including Netezza, Oracle, DB2, and Snowflake.
  • Experience implementing data transformation logic, performance tuning, automated data profiling, and multi-stage pipelines that support data accuracy, regulatory alignment, and consistency across downstream systems.
  • Experience designing automated data workflows and batch orchestration solutions and migrating or coordinating workloads across scheduling platforms such as Apache Airflow, TWS, and Control-M.
  • Experience managing task dependencies, parallel execution, and audit logging using DAGs, and executing DataStage and Snowflake jobs using UNIX scripts.
  • Experience designing and implementing cloud data warehousing solutions using Snowflake and Oracle; developing complex SQL and procedural logic for reporting and data validation; and optimizing transformations using CTEs, window functions, and pivoting.
  • Experience developing ingestion pipelines using Snowflake, Airflow, and ETL scripts and implementing CDC strategies for incremental and bulk-load optimization across AWS and Azure.

Responsibilities

  • Design and implement scalable, reusable cloud-based data management, reporting, database, pipeline, and integration solutions for analytics and web applications.
  • Develop data models, reports, visualizations, metrics frameworks, and reporting models for business intelligence and analytics.
  • Create cloud data platform patterns and data-lake consumption approaches for batch, near-real-time, high-performance, and cross-region workloads.
  • Build and refine CI/CD pipelines for data platforms, including versioned data assets and environment-specific configurations.
  • Establish and document technical standards, design patterns, and best practices for data engineering and reporting.
  • Troubleshoot complex data pipeline, platform, and reporting issues involving cross-system dependencies and large datasets.
  • Optimize cloud data platforms for performance, reliability, scalability, and cost efficiency.
  • Implement data integration solutions across cloud-based and traditional infrastructure, including transformation logic for customer consumption.
  • Perform software configuration management, test automation, version control, and static code analysis.
  • Integrate data activities with end-to-end development and maintain technical documentation for software projects and products.
  • Support SIT and UAT planning, release coordination, and production readiness.
  • Partner with product owners, analysts, and engineers to translate business needs into data solutions.
  • Participate in architecture, technical design, and product implementation discussions and contribute to architectural decisions.
  • Develop and implement advanced data engineering frameworks and enterprise data workflows.
  • Advise senior leadership on data infrastructure and technology solutions and provide data extracts to stakeholders.
  • Provide technical guidance and mentorship to less-experienced engineers.
  • Perform independent, complex technical and functional analysis for multiple divisional initiatives.
  • Implement data quality, reliability, auditability, and operational visibility capabilities.
  • Design and optimize enterprise ETL workflows, data transformations, data profiling, orchestration, and cloud data warehousing solutions.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service