Lead Azure Data Engineer

Ryan Specialty•Chicago, IL
•$140,000 - $175,000

About The Position

The Lead Azure Data Engineer reports to the VP of Data Engineering and implements data solutions in collaboration with Business Analysts, Data Analysts, IT teams, and key stakeholders. The role leads projects and coaches junior staff in building and optimizing data pipelines, integrating data from multiple sources, managing ETL processes, and ensuring data quality and consistency. It also helps keep data engineering practices aligned with current technologies and industry best practices, with an emphasis on performance, reliability, and efficiency. The position provides technical leadership across data architecture and engineering, and works with a broad range of Azure data services and tools. Responsibilities include developing and maintaining data pipelines, supporting data governance and quality, optimizing databases and reporting, and automating processes. The role also mentors less experienced team members and promotes a collaborative, innovative work environment. A bachelor’s degree is required; a master’s degree is preferred. A degree in computer science, information technology, or engineering is preferred, though another related discipline or commensurate work experience may be considered. Preferred experience is 12 or more years in data engineering with a bachelor’s degree, or 8 years with a master’s degree. Advanced Data Analytics Certifications (ADAC), SAS Statistical Business Analyst Professional Certification (SBAPC), or Cloudera Certified Professional (CCP) Data Engineer are a plus. Applicants must be authorized to work for any employer in the United States. The employer is unable to sponsor or take over sponsorship of an employment visa at this time. Ryan Specialty is an Equal Opportunity Employer and describes its commitment to building a diverse workforce and an inclusive, equitable workplace. Reasonable accommodations are available for applicants and employees with disabilities. The target annual salary range is $140,000–$175,000. Full-time roles are eligible for bonuses and benefits. Benefits include paid time off for company holidays, vacation, sick and personal days, paid parental leave, and mental health services; the company describes its broader benefits package as supporting employees’ and their family members’ physical, financial, and emotional well-being.

Requirements

  • Bachelor’s degree required; a master’s degree is preferred. Computer science, information technology, or engineering is preferred; another related discipline or commensurate work experience may be considered.
  • Preferred experience: 12 or more years in data engineering with a bachelor’s degree, or 8 years with a master’s degree.
  • Subject matter expertise in SQL Server management, Azure Data Factory development, Databricks engineering, Delta Parquet file management, and SQL Server Integration Services.
  • Proficiency in Profisee MDM integration, Change Data Capture implementation, and data quality and governance with Azure Purview.
  • Proven experience in Tableau and BI reporting, with strong automation and process skills.
  • Skills include big data analytics, leadership, data governance, data modeling, data processing, data warehousing, database management, ETL processes, machine learning, predictive analysis, and programming languages.
  • Behavioral skills include critical thinking, communication, relationship building, time management, problem solving, and attention to detail.
  • Must be authorized to work for any employer in the United States; visa sponsorship or transfer is not available.

Nice To Haves

  • Master’s degree.
  • Computer science, information technology, or engineering degree.
  • Advanced Data Analytics Certifications (ADAC), SAS Statistical Business Analyst Professional Certification (SBAPC), or Cloudera Certified Professional (CCP) Data Engineer.

Responsibilities

  • Provide technical leadership in data architecture and engineering, aligning data solutions with business objectives in collaboration with solution stakeholders.
  • Mentor less experienced data engineers and team members, and lead and coach junior staff on projects.
  • Explore and implement new data engineering technologies and practices to improve data processes and infrastructure.
  • Manage and enhance SSIS packages for data integration and ETL processes, as well as SSRS reports for business intelligence.
  • Design, build, and maintain scalable data pipelines using Azure Data Factory, including batch and real-time data integration.
  • Develop and optimize Databricks notebooks for big data processing and analytics in Azure Databricks.
  • Implement and manage Delta Parquet data storage in Azure Data Lake Storage, optimizing query performance and cost efficiency.
  • Integrate and configure Profisee Master Data Management tools in Azure, focusing on data governance and quality.
  • Set up and manage Change Data Capture processes for real-time data synchronization in Azure data platforms.
  • Implement data cataloging, classification, and lineage using Azure Purview; develop data governance policies and ensure compliance.
  • Enhance and support Tableau reporting solutions, develop complex dashboards, and integrate them with Azure data services.
  • Drive automation and process optimization using Azure services and scripting, and implement CI/CD pipelines using Azure DevOps.
  • Lead SQL Server database optimization and performance-tuning efforts.

Benefits

  • Paid time off for company holidays, vacation, sick days, and personal days.
  • Paid parental leave.
  • Mental health services.
  • Full-time roles are eligible for bonuses and benefits.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service