About The Position

USEReady is seeking a Senior Technical Lead – Azure Data Engineer with 8–10 years of experience and strong hands-on expertise in Microsoft Azure, Databricks, Azure Data Factory (ADF), Python, PySpark, and SQL. The role designs and implements scalable data engineering solutions, architects Databricks environments, optimizes data pipelines and workloads, and implements data governance and security using Unity Catalog. The candidate will work with large-scale distributed data platforms, mentor engineering teams, and collaborate with business and technical stakeholders to deliver high-quality data solutions. USEReady helps enterprises apply AI and agentic intelligence to improve decisions, automate operations, and build more autonomous business systems. The company modernizes BI environments, migrates legacy platforms, improves data quality, and enables governed, cloud-first architectures. Founded in 2011 and headquartered in New York City, USEReady has more than 450 experts across the United States, Canada, India, and Singapore, serving industries including financial services, healthcare, manufacturing, government, education, and retail.

Requirements

  • 8–10 years of overall experience in data engineering, with a strong focus on Azure.
  • Strong hands-on experience with Azure Databricks.
  • Excellent experience with Python and PySpark.
  • Strong knowledge of Apache Spark architecture, internals, and performance tuning.
  • Strong SQL skills, including complex queries, query optimization, and large-scale data processing.
  • Strong experience with Azure Data Factory (ADF).
  • Hands-on experience with Databricks Notebooks using Python and SQL.
  • Experience with Unity Catalog, data governance, security, and access control.
  • Strong understanding of Delta Lake.
  • Experience with Azure Data Lake Storage (ADLS).
  • Good understanding of data warehousing and data modeling, including Star and Snowflake schemas.
  • Experience working with large-scale distributed data processing environments.
  • Strong troubleshooting and performance optimization skills.

Nice To Haves

  • Experience with Azure Synapse Analytics.
  • Experience with Azure SQL Database.
  • Databricks or Azure Data Engineering certifications.
  • Experience implementing enterprise-level data governance and data lineage.
  • Experience mentoring technical teams and driving engineering best practices.
  • Strong stakeholder management and communication skills.

Responsibilities

  • Architect and design scalable Azure Databricks environments and data engineering solutions.
  • Design and implement robust, scalable, optimized data pipelines using Databricks and Azure Data Factory (ADF).
  • Develop Databricks notebooks using Python, PySpark, and SQL.
  • Implement and manage Unity Catalog for data governance, security, access control, and data discovery.
  • Design data models and define schema strategies, data structures, and pipeline organization.
  • Build and maintain Delta Lake tables and data models for analytics and BI workloads.
  • Optimize Databricks jobs, Spark workloads, SQL queries, and data pipelines for performance, scalability, and cost efficiency.
  • Apply knowledge of Apache Spark internals to troubleshoot and tune distributed data processing workloads.
  • Develop complex, optimized SQL queries, including efficient joins and processing large datasets.
  • Implement data quality, monitoring, validation, and reconciliation mechanisms.
  • Work with Azure data services including Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and Azure SQL Database.
  • Implement data governance, security, access controls, and data lineage.
  • Troubleshoot pipeline failures and performance issues and ensure reliability and uptime.
  • Collaborate with stakeholders to understand business requirements and translate them into scalable data solutions.
  • Identify opportunities to automate manual processes and improve data platform efficiency.
  • Mentor junior and mid-level engineers and establish best practices across Azure and Databricks development.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service