CLOUD AMAZE - Sr. DW Architect (Practice)
About The Position
We are seeking a Senior Data Warehouse Architect with expertise in data design, data warehousing, and technical architecture. The ideal candidate will have extensive experience in data discovery, analysis, quality, and integration, with a strong focus on designing and building real-time, near real-time, and batch data processing pipelines, primarily on the Azure cloud platform. This role involves debugging and developing ETL pipelines, managing data ingestion and transformations, and contributing to data governance frameworks. You will be responsible for building architecture frameworks, optimizing data pipelines for performance, and developing metadata-driven pipelines. A solid understanding of Azure data components like DataBricks, Data Lake, Purview, and Synapse is essential, along with familiarity with Power BI for visualizations. The ability to write high-performance, reliable, and maintainable code with modern data tools is crucial. Strong communication skills are also required.
Requirements
- 10+ years of experience in Data Discovery & Analysis, Data Quality and Data Integration.
- 7+ years of experience in designing and building real-time, near real-time, and batch data processing pipelines.
- Experience in data migration / data warehousing projects on cloud mainly Azure.
- Ability to debug and understand existing ETL and write new ETL pipelines.
- Hands-on experience with data ingestion and data transformations using Azure Data Factory, DataBricks, Synapse and other Azure services.
- Good understanding of data governance framework and tools.
- Experience in building architecture frameworks.
- Experience in debugging data pipelines for performance issues and providing solutions.
- Experience in building metadata-driven pipelines.
- Good understanding and hands-on experience on Azure components related to data (DataBricks, Data Lake, Purview, Synapse).
- Understanding of Power BI to create visualizations.
- Strong communication skills.
Nice To Haves
- Experience in Python/pyspark.
- Experience in writing high-performance, reliable and maintainable code with modern data tools.
Responsibilities
- Design and build real-time, near real-time, and batch data processing pipelines.
- Perform data migration and data warehousing projects on the cloud, primarily Azure.
- Debug and understand existing ETL processes and write new ETL pipelines.
- Manage data ingestion and data transformations using Azure Data Factory, DataBricks, Synapse, and other Azure services.
- Build architecture frameworks.
- Debug data pipelines for performance issues and provide solutions.
- Build metadata-driven pipelines.
- Create visualizations using Power BI.
- Write high-performance, reliable, and maintainable code with modern data tools.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
