Senior Data Platform Engineer
About The Position
This role involves building and standardizing the data integration platform that Endsight and its clients use, primarily within the Microsoft Fabric environment. Key responsibilities include architecture design, API-based data ingestion, and Model Context Protocol (MCP) server development. The goal is to translate team learnings into published and adopted engineering standards. The position requires designing and refining medallion-layered architecture, evaluating and building reference implementations for data ingestion and API integration, and developing MCP servers to meet internal security and reliability standards. Additionally, the role involves authoring and maintaining engineering standards, contributing to research and evaluation, and collaborating with domain owners to improve technical standards.
Requirements
- Two or more years of hands-on production experience with Microsoft Fabric, including lakehouse and warehouse design, medallion architecture, notebooks (PySpark and/or Python), ingestion pipelines, semantic models, and deployment pipelines
- Demonstrated API integration experience: REST and OAuth2, pagination, rate limiting, incremental and change-data-capture patterns, idempotent retries, and secrets management, in systems running unattended in production
- Demonstrated experience building and shipping MCP servers, including tool design, authorization scoping, structured error handling, and resistance to prompt injection
- Strong Python and SQL, infrastructure-as-code, and Git-based workflow
- A documented record of evaluating competing technical methods, writing the standard, and getting other engineers to adopt it
- A documented record of raising technical standards working in coordination with a team
- Comfort working with incompletely defined requirements and pushing back constructively on scope
Nice To Haves
- Breadth across the Azure data platform: Data Factory, Synapse, Purview, Key Vault, Entra application registration, Azure DevOps
- MSP or professional services background, including familiarity with PSA/RMM data models (ConnectWise, HaloPSA, NinjaOne) and multi-tenant data isolation
- Experience with other Orchestration Platforms (n8n, Rewst)
- Power Platform and Power Automate
- Experience migrating off a legacy business intelligence or reporting estate
- Experience integrating financial systems data (QuickBooks, Business Central, Adaptive Planning)
- Relevant Microsoft certifications (DP-600, DP-700, or equivalent)
Responsibilities
- Designing and refining medallion-layered architecture in Microsoft Fabric for Endsight and client environments
- Evaluating and building reference implementations for data ingestion and API integration methods, including incremental and change-data-capture patterns, schema-drift handling, and secrets management
- Building MCP servers to Endsight's internal security and reliability standards, covering authorization scope, fault handling, and injection resistance
- Authoring, publishing, and maintaining engineering standards, enabling other engineers to implement these standards through documentation, review, and pairing
- Taking a share of the team's research and evaluation queue and co-authoring the decision framework for what belongs in the central data platform
- Collaborating with existing domain owners to raise the technical bar
Benefits
- Medical: Company pays 100% of the base plan for the employee and family
- Dental & Vision
- 401(k) with employer matching
- Accrued Paid Time Off
- 9 Paid Holidays
- Career Development support and programs
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
