Information Technology_USA - USA_Technical Lead
About The Position
This role serves as the Technical Onsite Lead for Azure Databricks data engineering initiatives. The lead will supervise and guide an offshore development team, assigning work, reviewing deliverables, and ensuring adherence to best practices. Responsibilities include performing code reviews, design reviews, and solution walkthroughs for offshore-developed components, and ensuring alignment between offshore execution and onsite architecture, security, and business requirements. The role also involves proactively identifying risks, gaps, and improvement opportunities across the data platform. Technical responsibilities include designing, building, and orchestrating ETL/ELT pipelines using Azure Databricks, implementing batch data ingestion and transformations using PySpark and Spark SQL, and architecting and maintaining Lakehouse and analytical warehouse models (fact and dimension schemas) leveraging Delta Lake. The engineer will ensure data quality, reliability, lineage, and governance, and collaborate with security and platform teams to enforce data access controls and best practices. Experience with CI/CD pipelines using Git for Databricks is also required.
Requirements
- 6-10 years of hands-on experience in data engineering.
- Strong, proven expertise in Azure Databricks and Delta Lake.
- Advanced proficiency in SQL with a solid understanding of distributed data processing concepts.
- Demonstrated experience leading, mentoring, or supervising data engineering teams.
- Strong experience performing code reviews and solution design validations.
- Knowledge of data security and access management (RBAC).
- Experience working in a hybrid onsite–offshore delivery model.
Nice To Haves
- Experience with Azure Synapse / Fabric
- Experience with Azure Data Factory
- Experience with PL/SQL
Responsibilities
- Act as the onsite lead for Azure Databricks data engineering initiatives.
- Supervise and guide an offshore development team, assigning work, reviewing deliverables, and ensuring adherence to best practices.
- Perform code reviews, design reviews, and solution walkthroughs for offshore-developed components.
- Ensure alignment between offshore execution and onsite architecture, security, and business requirements.
- Proactively identify risks, gaps, and improvement opportunities across the data platform.
- Design, build, and orchestrate ETL/ELT pipelines using Azure Databricks.
- Implement batch data ingestion and transformations using PySpark and Spark SQL.
- Architect and maintain Lakehouse and analytical warehouse models (fact and dimension schemas) leveraging Delta Lake.
- Ensure data quality, reliability, lineage, and governance across the data platform.
- Collaborate with security and platform teams to enforce data access controls and best practices.
- Utilize CI/CD pipelines using Git for Databricks.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
