Senior Data Engineer

PA Consulting•Boston, MA

4h•$90,000 - $125,000•Hybrid

About The Position

We’re an innovation and transformation consultancy that believes in the power of ingenuity to build a positive-human future in a technology-driven world. Our diverse teams of experts combine innovative thinking with breakthrough-technologies to progress further, faster. Are you ready to harness the power of data to drive advancements in healthcare? Are you passionate about both developing new capabilities and ensuring the optimization and reliability of existing data systems? Are you passionate about designing, building, and operating data infrastructure that plays a pivotal role in improving patient outcomes and shaping the future of medicine? If you're seeking a rewarding career at the intersection of healthcare and technology, we invite you to be part of our dynamic team. This is a unique, multi-year, project-based opportunity to build and grow a clinical data registry platform over many years working with a dedicated team of collaborators and customers. As a Data Engineer for our cutting-edge medical data registry, you'll be at the forefront of managing, optimizing, and expanding our data infrastructure, enabling critical insights that can positively impact patient outcomes. This role provides a dynamic mix of innovative new development—enhancements, optimizations, and Proofs of Concept—alongside meaningful hands‑on ownership of production pipelines, data flows, and platform operations. You will contribute to system improvements while also owning the monitoring, troubleshooting, tuning, and day-to-day reliability of the existing data ecosystem. If you're excited about leveraging your data engineering skills to make a difference in the world of healthcare, we want to hear from you.

Requirements

At least 6 years of industry working experience
Advanced SQL and Python
Expertise in the design and construction of Big Data Lakes and Data Warehouses capable of ingesting, standardizing, and serving billions of data rows spanning diverse datasets ranging from tens to hundreds
Experience building dynamic, metadata driven pipelines and analyses
Experience maintaining and supporting production data systems, including pipeline monitoring, troubleshooting, and delivering long‑term reliability and optimization enhancements
Building and managing fully automated data pipelines (ETL, ELT, ELTL) including:
Designing and building data interfaces to source systems
Combining and transforming data into the appropriate format for storage
Developing data sets for analytics purposes
Developing pipelines that can handle common issues/errors in a robust and automated way
Implementing data quality checks, observability, and cost/performance optimization
Cloud experience in Azure, AWS or GCP
Ability to balance enhancement work with operational responsibilities in a production environment

Nice To Haves

Spark / PySpark experience highly preferable
Working in Agile and DevOps environments
Basic Python, Bash, or PowerShell for automation
Data modelling – Kimball, Data Vault, Star/Snowflake schema, Query-first etc.
Data visualisation in Power BI, Tableau, Qlik or similar
Architecting Data Platforms - designing BI/MI/Analytics solutions using Big Data, Relational or Streaming technologies
Experience with monitoring/observability tools (logging, alerting, pipeline health dashboards)
Microsoft Certified: Azure Data Engineer Associate
AWS Certified Data Analytics - Specialty
GCP Professional Data Engineers

Responsibilities

Managing, optimizing, and expanding our data infrastructure
Innovative new development—enhancements, optimizations, and Proofs of Concept
Hands‑on ownership of production pipelines, data flows, and platform operations
System improvements
Owning the monitoring, troubleshooting, tuning, and day-to-day reliability of the existing data ecosystem