In this role, you will design and develop scalable data pipelines leveraging Azure Data Factory, Azure Synapse, and Databricks to build, optimize, and maintain robust ETL/ELT pipelines for large-scale data processing and analytics. You will manage and monitor cloud-based data solutions, overseeing the deployment, performance, and security of cloud applications, ensuring compliance with best practices in network security and cloud governance. Collaboration across teams for data integration is essential, as you will work closely with data engineers, analysts, and business stakeholders to gather requirements, design solutions, and ensure seamless data integration across platforms. You will implement CI/CD and version control practices utilizing Git repositories and release pipelines to manage code versioning, automate deployments, and maintain high-quality development standards. Additionally, you will ensure data quality and performance optimization by writing efficient SQL and PySpark code, conducting performance tuning, and troubleshooting issues to ensure data accuracy, reliability, and optimal system performance.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Industry
Professional, Scientific, and Technical Services