Managing Data Architect - Azure Databricks Architect

Capgemini • Houston, TX

2d

About The Position

Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.Job DescriptionYour Role:

Technical Leadership & Delivery Architect and implement scalable data integration and analytics solutions using Azure Data Services (Databricks, Synapse, ADF,).
Lead development of reusable frameworks for data ingestion, transformation, and analytics.
Ensure delivery excellence through code quality, performance optimization, and best practices in Python, PySpark, and SQL. (C# will be a plus)
Apply Azure identity and security principles including Managed Identities, Azure AD authentication, Key Vault integration, Networking (VNETs, private endpoints), and RBAC.
Maintain a high standard of documentation hygiene across solution components and processes.
Mentor and guide a team of data engineers and developers, fostering a culture of accountability.
Conduct regular code reviews, pair programming sessions, and internal knowledge sharing session with delivery team.
Plan and manage workstreams, delegating effectively to reduce dependencies and minimize technical debt.
Lead technical discussions with client, clear documenting assumptions, expectations and solution design.
Collaborate with business stakeholders to understand requirements, translate them into technical solutions, and manage expectations.
Communicate status, risks, decisions and mitigation strategies to both technical and non technical audiences with clarity.
Define solution roadmaps aligned to enterprise strategy, business priorities, and architectural standards.
Proactively identify risks and drive alignment to ensure predictable, high quality delivery.
Champion modern engineering practices including DevOps, CI/CD pipelines, IaC, automated testing, and repeatable deployment patterns.

Requirements

• 10+ years of experience in data engineering, analytics, or solution architecture.
• Strong hands-on experience with: o Azure Databricks (Spark, Delta, ML runtime)o Azure Synapse Analytics (serverless, pipelines, dedicated pools)o Azure Data Factory / Synapse Pipelineso Data Lake Storage Gen2, Databricks Unity Catalog, Spark SQLo Python, PySpark, Spark optimizationo Azure DevOps, CI/CD, and Infrastructure as Codeo Cloud security & identity: Managed identities, Azure AD, Key Vault, RBAC, networking fundamentals
• Proven experience in leading technical teams and managing delivery in Agile framework.
• Excellent communication and interpersonal skills; able to influence and lead cross-functional teams.
• Experience in stakeholder management, risk assessment, and project planning

Nice To Haves

• Azure certifications (e.g., Azure Solutions Architect Expert, Azure Data Engineer Associate, Databricks certifications).
• Experience in oil & gas, industrial or asset-heavy domains.

Responsibilities

• Technical Leadership & Delivery Architect and implement scalable data integration and analytics solutions using Azure Data Services (Databricks, Synapse, ADF,).
• Lead development of reusable frameworks for data ingestion, transformation, and analytics.
• Ensure delivery excellence through code quality, performance optimization, and best practices in Python, PySpark, and SQL. (C# will be a plus)
• Apply Azure identity and security principles including Managed Identities, Azure AD authentication, Key Vault integration, Networking (VNETs, private endpoints), and RBAC.
• Maintain a high standard of documentation hygiene across solution components and processes.
• Mentor and guide a team of data engineers and developers, fostering a culture of accountability.
• Conduct regular code reviews, pair programming sessions, and internal knowledge sharing session with delivery team.
• Plan and manage workstreams, delegating effectively to reduce dependencies and minimize technical debt.
• Lead technical discussions with client, clear documenting assumptions, expectations and solution design.
• Collaborate with business stakeholders to understand requirements, translate them into technical solutions, and manage expectations.
• Communicate status, risks, decisions and mitigation strategies to both technical and non technical audiences with clarity.
• Define solution roadmaps aligned to enterprise strategy, business priorities, and architectural standards.
• Proactively identify risks and drive alignment to ensure predictable, high quality delivery.
• Champion modern engineering practices including DevOps, CI/CD pipelines, IaC, automated testing, and repeatable deployment patterns.

Benefits

• Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
• Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
• Life and disability insurance
• Employee assistance programs
• Other benefits as provided by local policy and eligibility

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed
• Number of Employees: 5,001-10,000 employees