Information Technology_USA - USA_Engineer
About The Position
We are seeking an experienced Azure Data Engineer with a minimum of 10 years of experience, including significant work in the banking domain. The role involves creating data pipelines, migrating data from on-premise databases to Azure Cloud, and working extensively with Azure Databricks, ADLS, Synapse, and Azure Data Factory. You will be responsible for creating Azure Databricks services, reading and writing data to Azure Blob storage and Azure Synapse Gen2 storage in various formats (CSV, Parquet, JSON) from Snowflake DWH platform, and utilizing Databricks File System (DBFS). Experience with RDD, Dataframe, and Azure SQL database is also required.
Requirements
- Minimum 10 years of experience
- Good work experience in Banking domain
- Strong experience in Azure Databricks, ADLS, Synapse and Azure Data Factory
- Experience in creating data pipelines and migrating data from on-prem database to Azure Cloud
- Experience creating Azure Databricks services
- Experience reading & writing data from/to Azure Blob storage & Azure Synapse Gen2 storage using Azure Databricks services after receiving in different formats (e.g. csv, Parquet, Jason etc.) from Snowflake DWH platform
- Hands-on experience in working with Databricks File system (DBFS)
- Experience in working with RDD, Dataframe, Azure SQL database
- Very strong experience in SQL and Python
- Very good analytical and problem-solving ability
- Very good communication skills
Nice To Haves
- Experience working in Snowflake would be preferred
Responsibilities
- Creating data pipelines
- Migrating data from on-premise databases to Azure Cloud
- Creating Azure Databricks services
- Reading & writing data from/to Azure Blob storage & Azure Synapse Gen2 storage using Azure Databricks services
- Working with Databricks File system (DBFS)
- Working with RDD, Dataframe, Azure SQL database
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
