Data Engineer

Fragomen
2dHybrid

About The Position

Fragomen is seeking a Data Engineer to join our Data Engineering Team within Technology & Innovation. This role focuses on building and scaling cloud data pipelines on Microsoft Fabric, while continuing to support and modernize legacy on-prem SQL Server and SSIS workloads. The Cloud Data Engineer will work closely with Platform Administrators, BI teams, and business stakeholders to deliver reliable, metadata-driven data solutions that support enterprise reporting and analytics. What Software Engineers do here: Cloud & Fabric Data Engineering Build and maintain end-to-end data pipelines using Microsoft Fabric. Develop orchestration using Fabric Data Factory pipelines. Build and manage Fabric Dataflows for ingestion and transformation. Develop PySpark transformations using Fabric Notebooks and Lakehouse architecture. Implement metadata-driven frameworks supporting incremental and full loads. Ingest data from databases, APIs, files, and semi-structured sources. Platform Collaboration Partner closely with Platform Administrators on: Workspace design and access controls Capacity planning and performance Deployment, monitoring, and operational standards Follow and contribute to Fabric development and promotion standards. Legacy Platform Support Support and enhance on-prem SQL Server and SSIS ETL workloads. Develop and optimize SSIS packages, T-SQL stored procedures, functions, and views. Troubleshoot performance issues and validate data across cloud and on-prem systems. Support incremental migration of legacy workloads to Fabric. Data Quality & Collaboration Validate and reconcile data for accuracy and consistency. Collaborate with BI and analytics teams to support reporting needs. Document pipelines, frameworks, and operational processes. What we expect from our Software Engineers: Participate in solution design and technical decision-making. Build robust, reusable, production-grade data pipelines. Apply strong engineering discipline including version control and structured deployments. Thrive in a collaborative, fast-paced environment.

Requirements

  • 6+ years of experience in Data Engineering or related roles.
  • Hands-on experience with Microsoft Fabric.
  • Experience with Fabric Data Factory pipelines and Fabric Dataflows.
  • Strong PySpark and SQL Server skills.
  • Experience with SSIS-based ETL processes.
  • Strong understanding of metadata-driven ETL design.
  • Experience with JSON, XML, and semi-structured data.
  • Excellent written and verbal communication skills.

Nice To Haves

  • Hybrid (cloud + on-prem) data architecture experience.
  • CI/CD exposure for data engineering workloads.
  • Power BI or downstream analytics experience.

Responsibilities

  • Build and maintain end-to-end data pipelines using Microsoft Fabric.
  • Develop orchestration using Fabric Data Factory pipelines.
  • Build and manage Fabric Dataflows for ingestion and transformation.
  • Develop PySpark transformations using Fabric Notebooks and Lakehouse architecture.
  • Implement metadata-driven frameworks supporting incremental and full loads.
  • Ingest data from databases, APIs, files, and semi-structured sources.
  • Partner closely with Platform Administrators on: Workspace design and access controls Capacity planning and performance Deployment, monitoring, and operational standards Follow and contribute to Fabric development and promotion standards.
  • Support and enhance on-prem SQL Server and SSIS ETL workloads.
  • Develop and optimize SSIS packages, T-SQL stored procedures, functions, and views.
  • Troubleshoot performance issues and validate data across cloud and on-prem systems.
  • Support incremental migration of legacy workloads to Fabric.
  • Validate and reconcile data for accuracy and consistency.
  • Collaborate with BI and analytics teams to support reporting needs.
  • Document pipelines, frameworks, and operational processes.
  • Participate in solution design and technical decision-making.
  • Build robust, reusable, production-grade data pipelines.
  • Apply strong engineering discipline including version control and structured deployments.
  • Thrive in a collaborative, fast-paced environment.

Benefits

  • Fragomen is committed to promoting diversity, inclusion and equal opportunity for all employees and applicants, regardless of race, ethnicity, heritage, gender, age, religion, disability, sexual orientation, gender identity or intersex status.
  • Our #FragomenWorks program provides the ability to be successful at home or in the office, via Hybrid & Remote work arrangements.
  • Our Feedback Works process includes three managerial check-ins per year to help you progress in your career.
  • Unique learning programs like: Fragomen Academy, Leadership Academy, Practical Management Academy, and Regional Development Conferences.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Education Level

No Education Listed

Number of Employees

5,001-10,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service