This role involves supporting the migration from Synapse to Databricks by building and maintaining robust infrastructure and deployment pipelines. The engineer will automate the provisioning, configuration, and monitoring of Databricks environments across multiple data streams, ensuring smooth CI/CD processes for data engineering workloads. This includes automating initial data loads, deploying data marts and consumption layers, and integrating with reporting and Power BI solutions. The position requires collaboration with Data Engineers, product teams, and business stakeholders to ensure reliable and secure data delivery, while also optimizing system performance, scalability, and cost-efficiency in cloud environments. The role also involves implementing monitoring, alerting, and logging solutions, writing and maintaining Infrastructure as Code (IaC), and troubleshooting environment, pipeline, and integration issues. Staying current with DevOps best practices and emerging technologies is also a key aspect of this role.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed