Senior Data Engineer

Ciklum • United States,

4d • Onsite

About The Position

Ciklum is looking for a Senior Data Engineer to join our team full-time in the US. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

As a Senior Data Engineer, become a part of a cross-functional development team engineering experiences of tomorrow. We are seeking a highly motivated and hands-on Full Stack Data Engineer with strong experience in Microsoft Fabric and modern Azure-based data platforms. The ideal candidate should be capable of working across the full stack of data engineering — from ingestion and transformation to Gold-layer curation, analytics enablement, API integration, and AI-assisted application workflows. This role requires engineers who can work independently, leverage AI-assisted development for rapid delivery, and collaborate across data, cloud, and lightweight application layers. Exposure to MCP (Model Context Protocol), ReactJS integration, and modern AI-enabled engineering practices is highly preferred.

Requirements

• 6 years in Data Engineering
• Hands-on exposure to Microsoft Fabric (preferred) or strong Azure Data Engineering background with willingness to learn Fabric
• Microsoft Fabric (Data Factory, OneLake, Synapse Data Engineering – basics)
• Azure Data Services: ADLS Gen2, Azure SQL, Blob Storage
• Strong SQL (joins, aggregations, performance tuning basics)
• Python (PySpark) for data transformation
• Azure Data Factory / Fabric Pipelines

Nice To Haves

• Azure Functions / Logic Apps
• Event Hubs / streaming concepts
• Microsoft Purview (basic exposure)
• Cosmos DB

Responsibilities

• Manage OneLake structures and shortcuts for scalable enterprise data access
• Design scalable Lakehouse solutions using Medallion Architecture (Bronze, Silver, Gold)
• Build and optimize Delta Lake tables for analytics, reporting, and AI workloads
• Develop data pipelines using Fabric Data Factory, Spark, and Notebooks
• Create ingestion and transformation workflows for structured and semi-structured data
• Implement orchestration, scheduling, monitoring, and recovery for enterprise pipelines
• Design dimensional models (Star/Snowflake schemas) for BI and semantic layers
• Build curated Gold-layer datasets for analytics and AI consumption
• Support integration with Power BI semantic models and reporting platforms
• Develop batch and incremental pipelines across Azure and external systems
• Orchestrate ETL/ELT workflows using Fabric Pipelines and Azure Data Factory
• Integrate Fabric platforms with APIs, AI services, and enterprise applications
• Support MCP integration, AI workflows, and rapid prototyping initiatives
• Collaborate on ReactJS-based apps, dashboards, and AI-driven user experiences
• Automate workflows using Azure Functions, Logic Apps, Git, CI/CD, and Azure DevOps
• Develop and optimize PySpark notebooks for transformation, cleansing, and enrichment
• Build efficient SQL queries, views, and stored procedures in Fabric Warehouse / Azure SQL
• Implement optimization techniques including partitioning, caching, and query tuning
• Monitor pipeline performance, troubleshoot failures, and improve system reliability
• Implement logging, alerting, and operational best practices
• Utilize AI-assisted development tools such as GitHub Copilot and modern AI coding assistants
• Rapidly prototype and deliver scalable engineering solutions with minimal guidance
• Implement RBAC and secure data access across Fabric workspaces and Azure environments
• Apply data quality validations and governance best practices
• Support metadata management and lineage using Microsoft Purview
• Collaborate with Data Architects, Analysts, BI Developers, Product Teams, and Business Stakeholders
• Translate business requirements into scalable data and application solutions
• Participate in Agile delivery processes, code reviews, and pull request workflows

Benefits

• Healthcare
• Basic Life Insurance
• Short and Long-term disability insurance according to the Company’s Benefit Plans
• Internal events (meetups, conferences, workshops)
• Udemy access
• Language courses
• Company-paid certifications

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed