Managing Data Architect - Azure Databricks Architect

Capgemini • Houston, TX

19d

About The Position

We are seeking a dynamic and experienced Senior Technical Lead with deep expertise across the Azure data ecosystem to drive the delivery of data and analytics solutions on Azure. This role requires a strong blend of hands-on technical expertise, leadership, and stakeholder engagement. The ideal candidate will be a strategic thinker, a skilled communicator, and a proactive problem solver with a proven track record in managing technical teams and delivering complex data projects.

Requirements

• 10+ years of experience in data engineering, analytics, or solution architecture.
• Strong hands-on experience with: Azure Databricks (Spark, Delta, ML runtime) Azure Synapse Analytics (serverless, pipelines, dedicated pools) Azure Data Factory / Synapse Pipelines Data Lake Storage Gen2, Databricks Unity Catalog, Spark SQL Python, PySpark, Spark optimization Azure DevOps, CI/CD, and Infrastructure as Code Cloud security & identity: Managed identities, Azure AD, Key Vault, RBAC, networking fundamentals
• Proven experience in leading technical teams and managing delivery in Agile framework.
• Excellent communication and interpersonal skills; able to influence and lead cross-functional teams.
• Experience in stakeholder management, risk assessment, and project planning

Nice To Haves

• Azure certifications (e.g., Azure Solutions Architect Expert, Azure Data Engineer Associate, Databricks certifications).
• Experience in oil & gas, industrial or asset-heavy domains.

Responsibilities

• Architect and implement scalable data integration and analytics solutions using Azure Data Services (Databricks, Synapse, ADF,).
• Lead development of reusable frameworks for data ingestion, transformation, and analytics.
• Ensure delivery excellence through code quality, performance optimization, and best practices in Python, PySpark, and SQL. (C# will be a plus)
• Apply Azure identity and security principles including Managed Identities, Azure AD authentication, Key Vault integration, Networking (VNETs, private endpoints), and RBAC.
• Maintain a high standard of documentation hygiene across solution components and processes.
• Mentor and guide a team of data engineers and developers, fostering a culture of accountability.
• Conduct regular code reviews, pair programming sessions, and internal knowledge sharing session with delivery team.
• Plan and manage workstreams, delegating effectively to reduce dependencies and minimize technical debt.
• Lead technical discussions with client, clear documenting assumptions, expectations and solution design.
• Collaborate with business stakeholders to understand requirements, translate them into technical solutions, and manage expectations.
• Communicate status, risks, decisions and mitigation strategies to both technical and non technical audiences with clarity.
• Define solution roadmaps aligned to enterprise strategy, business priorities, and architectural standards.
• Proactively identify risks and drive alignment to ensure predictable, high quality delivery.
• Champion modern engineering practices including DevOps, CI/CD pipelines, IaC, automated testing, and repeatable deployment patterns.

Benefits

• Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
• Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
• Life and disability insurance
• Employee assistance programs
• Other benefits as provided by local policy and eligibility

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed