Data Platform Engineer

CapgeminiNew York, NY
21d$90,000 - $110,786Hybrid

About The Position

We are seeking a highly skilled Data Platform Engineer to design, build, and optimize data solutions using Microsoft Fabric, OneLake, and modern data architecture patterns. The ideal candidate will have strong experience in building scalable data pipelines, enabling Fabric‑native data capabilities, and driving cloud modernization initiatives within the Microsoft ecosystem. Design and develop data pipelines and models using Microsoft Fabric and OneLake, with a strong focus on interoperability and performance using columnar formats like Parquet and efficient serialization formats like Protobuf. Collaborate with cross-functional teams (Product Owners, Azure Solution Architects, Data & Software Engineers) to drive a Fabric-native data platform that integrates seamlessly with Power BI. Enable modern data architecture patterns, including Lakehouse, near real-time streaming, schema evolution, and efficient serialization in messaging and APIs. Maintain and automate scalable data pipelines, emphasizing performance, metadata consistency, and optimal use of storage formats such as Parquet within the Microsoft ecosystem. Champion DevOps practices, implementing CI/CD pipelines (via Azure DevOps or GitLab Pipelines) and Infrastructure-as-Code for consistent, secure deployment of Fabric-based solutions. Monitor and optimize platform performance using observability tools, ensuring health, reliability, and cost-efficiency.Drive cloud migration and modernization efforts, guiding the transition to Microsoft Azure and Fabric, ensuring format and schema

Requirements

  • Strong experience with Microsoft Fabric, OneLake, and Azure data services.
  • Hands-on expertise with Parquet, Protobuf, and modern serialization/storage formats.
  • Experience designing and automating scalable data pipelines.
  • Solid understanding of data modeling, schema evolution, streaming architectures, and lakehouse principles.
  • Strong background in DevOps practices, CI/CD automation, and IaC tools.
  • Experience collaborating with cross-functional engineering and product teams.
  • Strong problem‑solving, optimization, and analytical skills.

Responsibilities

  • Design and develop data pipelines and models using Microsoft Fabric and OneLake, with a strong focus on interoperability and performance using columnar formats like Parquet and efficient serialization formats like Protobuf.
  • Collaborate with cross-functional teams (Product Owners, Azure Solution Architects, Data & Software Engineers) to drive a Fabric-native data platform that integrates seamlessly with Power BI.
  • Enable modern data architecture patterns, including Lakehouse, near real-time streaming, schema evolution, and efficient serialization in messaging and APIs.
  • Maintain and automate scalable data pipelines, emphasizing performance, metadata consistency, and optimal use of storage formats such as Parquet within the Microsoft ecosystem.
  • Champion DevOps practices, implementing CI/CD pipelines (via Azure DevOps or GitLab Pipelines) and Infrastructure-as-Code for consistent, secure deployment of Fabric-based solutions.
  • Monitor and optimize platform performance using observability tools, ensuring health, reliability, and cost-efficiency.
  • Drive cloud migration and modernization efforts, guiding the transition to Microsoft Azure and Fabric, ensuring format and schema

Benefits

  • Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
  • Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
  • Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
  • Life and disability insurance
  • Employee assistance programs
  • Other benefits as provided by local policy and eligibility

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Education Level

No Education Listed

Number of Employees

5,001-10,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service