Junior Data Engineer (Azure Databricks)

Miratech

6d•Remote

About The Position

We are looking for a Junior Data Engineer specialized in Azure Databricks to join our data platform team. The candidate will develop and support modern data pipelines and Lakehouse architectures, leveraging Azure Databricks, Spark, and Azure Data Factory, while integrating with existing SQL Server-based data warehouse environments. The role offers an opportunity to learn and grow within a modern cloud data ecosystem while contributing to analytics and business intelligence initiatives.

Requirements

2+ years of experience in Data Engineering, Data Warehouse development, or a related field
Experience with Azure Databricks
Experience developing data pipelines using PySpark and Spark SQL
Understanding of distributed data processing and big data concepts
Good SQL skills and experience with SQL Server relational databases
Experience building data pipelines using Azure Data Factory
Exposure to data processing and performance optimization concepts
Strong analytical and problem-solving skills
Good communication and collaboration skills
Team player with a proactive mindset
Eager to learn and continuously develop technical expertise
Adaptable and comfortable working in dynamic environments

Nice To Haves

Knowledge of Spark optimization techniques (partitioning, caching, cluster tuning)
Familiarity with Power BI and Databricks Structured Streaming
Experience in migrating from traditional ETL process to cloud architectures
Familiarity with Delta Lake and Lakehouse architectures

Responsibilities

Support and evolve existing SQL Server data platforms and ETL solutions
Develop and maintain data pipelines using Azure Databricks
Build and optimize data transformations using PySpark and SQL in Databricks
Develop ETL/ELT pipelines orchestrated through Azure Data Factory
Integrate data from multiple sources into the data platform and analytical layers
Maintain data models and data warehouse structures for analytics
Ensure data quality, scalability, and performance of large-scale data processing pipelines
Collaborate with BI teams to support Power BI and reporting platforms
Participate in the implementation of modern cloud-based data architectures under guidance from senior team members