Microsoft Fabric Data Engineer

Derex Technologies Inc•Erie, PA

2d•Onsite

About The Position

The Microsoft Fabric Core Lead Engineer is responsible for leading the design, development, implementation, and support of enterprise-scale data and analytics solutions using Microsoft Fabric. The role provides technical leadership, drives architecture decisions, mentors engineering teams, and ensures successful delivery of scalable, secure, and high-performing data platforms.

Requirements

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
10+ years of experience in Data Engineering, Data Warehousing, or Cloud Data Platform development.
4+ years of hands-on experience with Microsoft Azure Data Platform technologies.
2+ years of hands-on experience with Microsoft Fabric in enterprise implementations.
Strong expertise in SQL, PySpark, Python, and Spark optimization.
Experience with Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Power BI, and Real-Time Intelligence.
Experience with Azure Data Lake Storage (ADLS), Azure DevOps, GitHub, and CI/CD pipelines.
Strong knowledge of dimensional data modeling, ETL/ELT architecture, and data governance.
Experience leading technical teams and delivering large-scale enterprise data modernization programs.

Nice To Haves

Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
Microsoft Azure Data Engineer Associate (DP-203)
Experience with Databricks, Synapse Analytics, Azure AI Services, or Microsoft Purview.
Knowledge of Agile/Scrum delivery methodologies.
Strong communication, stakeholder management, and problem-solving skills.

Responsibilities

Lead the end-to-end implementation of Microsoft Fabric solutions across enterprise programs.
Define technical architecture, engineering standards, and best practices for Microsoft Fabric adoption.
Provide technical leadership to a team of data engineers and developers.
Review solution designs, code, and deployment strategies to ensure quality and scalability.
Design and implement enterprise data platforms using Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Real-Time Intelligence, Data Engineering, and Power BI.
Architect scalable, cloud-native data solutions supporting analytics, AI, and business intelligence workloads.
Establish reusable design patterns and reference architectures.
Design and develop robust ETL/ELT pipelines using Microsoft Fabric Data Factory and Spark Notebooks.
Integrate structured, semi-structured, and unstructured data from cloud and on-premises systems.
Implement data transformation, cleansing, validation, and orchestration processes.
Optimize data ingestion strategies for performance and reliability.
Design dimensional models, Lakehouse architectures, and enterprise data warehouses.
Develop semantic models and datasets for Power BI reporting and self-service analytics.
Collaborate with business teams to translate analytical requirements into scalable data solutions.
Optimize Spark workloads, SQL Warehouse performance, and OneLake storage utilization.
Implement partitioning, indexing, caching, and workload optimization strategies.
Monitor platform performance and proactively resolve bottlenecks.
Implement enterprise security using Microsoft Entra ID, RBAC, and Fabric workspace security.
Define governance policies for data quality, lineage, cataloging, auditing, and compliance.
Ensure adherence to enterprise security, privacy, and regulatory standards.
Implement CI/CD pipelines using Azure DevOps or GitHub.
Automate deployment of Microsoft Fabric artifacts across Development, QA, UAT, and Production environments.
Manage source control, release management, and deployment automation.
Enable AI, Machine Learning, and Copilot capabilities within Microsoft Fabric.
Support Data Science workloads using Spark, notebooks, and ML models.
Collaborate with AI teams to operationalize predictive analytics and intelligent data solutions.
Lead production deployments and post-production support activities.
Monitor platform health, troubleshoot incidents, and ensure SLA compliance.
Implement disaster recovery, backup, and business continuity strategies.
Collaborate with enterprise architects, product owners, business stakeholders, and cross-functional teams.
Participate in architecture review boards and technical governance meetings.
Communicate technical solutions and project status to senior leadership.
Mentor junior and senior engineers on Microsoft Fabric technologies and engineering best practices.
Conduct code reviews, design reviews, and technical knowledge-sharing sessions.
Drive continuous improvement initiatives and foster engineering excellence.