Databricks Solutions Architect Senior Manager

Protiviti • New York City, NY

11d • Hybrid

About The Position

Protiviti is seeking a Technology Consulting Senior Manager to join its growing Enterprise Data & Analytics team. The role partners with clients to identify and manage risk, develop strategies for complex business problems, and design and deliver modern data engineering solutions using Databricks and related technologies. The Senior Manager builds lasting client relationships through high-quality delivery, represents Protiviti in the business community, and contributes to business development and client proposals.

The position oversees successful project work plans and leads, mentors, coaches, and develops teams. It includes architecting, implementing, optimizing, securing, and maintaining data platforms and engineering solutions; helping clients define data strategies and migrate systems to Databricks; and applying governance, DevOps or DataOps, analytics, and data modeling practices. The role is hybrid, combining purposeful in-person work with remote work. In-person work may take place in local Protiviti offices or client sites, and travel may be local or out of state depending on project and client needs.

Requirements

• Bachelor’s degree in a relevant discipline, such as MIS, CIS, or Analytics.
• At least 7 years of experience working in professional services or a related industry.
• Professional Databricks certification: Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional.
• Experience articulating Databricks capabilities and using data storytelling to guide decision-making.
• Advanced ability to architect future-state data solutions using Well-Architected Frameworks aligned to Databricks.
• Highly proficient in implementing ETL processes and databases using Databricks or complementary solutions.
• Significant experience optimizing data implementations, including pipelines, queries, and data models.
• Highly proficient in data engineering, including data movement, integration, transformation, and cleansing.
• Highly skilled in data modeling, including entity-relationship, dimensional, and semantic modeling.
• Expertise in SQL and Spark, including PySpark and Spark SQL.
• Experience implementing data governance frameworks and policies, including managing data assets with Unity Catalog.
• Understanding of data security practices, including encryption and access control, and networking as applied to Databricks on-premises or in cloud solutions.
• Understanding of DevOps or DataOps concepts and experience deploying Databricks solutions.
• Competency with at least three and exposure to most of the listed technologies: Databricks Lakehouse architecture and medallion design patterns; Unity Catalog; Apache Spark and Delta Lake; Auto Loader, Lakeflow Declarative Pipelines, and workflow orchestration; Databricks Asset Bundles, Git integration, CI/CD, and environment promotion; Databricks SQL, serverless compute, query optimization, and performance tuning.
• Leadership and direct supervisory experience, including performance appraisals, mentoring and coaching, oversight and review of work, cross-team coordination, and motivating teams.
• Ability to evaluate, summarize, organize, and interpret data.
• Ability to establish professional relationships, pursue business development opportunities, and communicate issues and risks to client personnel, including executives.

Nice To Haves

• Databricks Champion certification or recognition.
• Experience with data science and/or machine learning.
• Familiarity with programming languages such as C#, Java, Scala, R, DAX, MDX, or M.
• Experience with Mosaic AI, MLflow, model serving, and generative AI capabilities.

Responsibilities

• Partner with clients to identify and manage risk and develop strategies and solutions for complex business problems.
• Design, architect, implement, and optimize modern data engineering solutions using Databricks and related technologies.
• Formulate, communicate, and execute data strategies aligned with organizational goals.
• Assess existing on-premises and cloud data solutions and plan migrations from on-premises, other cloud platforms, or legacy systems to Databricks.
• Lead data engineering, data integration, ETL, data warehousing, modern data platform, data modeling, and analytics work.
• Implement and maintain data governance, security, stability, scalability, and affordability practices.
• Oversee successful completion of project work plans and manage project deliverables.
• Build and maintain client relationships, provide high-quality client service, and communicate issues, risks, and challenges to client personnel, including executives.
• Mentor, coach, and develop team members; conduct performance appraisals; coordinate work across teams; and foster an inclusive, positive team culture.
• Participate in creating and delivering training and development opportunities for teams.
• Contribute to client proposals, business development, and strategies to win new work and clientele.
• Identify opportunities to integrate product solutions and resources to improve client service capabilities.
• Establish and cultivate business relationships and a professional network, including with senior executives.

Benefits

• Annual bonus plan with eligible employees offered additional cash and/or discretionary stock compensation opportunities; the stated bonus target opportunity is 14%.
• Medical, dental, and vision coverage.
• Flexible spending and health savings accounts.
• Life and accident insurance.
• Adoption and fertility assistance.
• Paid parental leave up to 10 weeks.
• Short- and long-term disability insurance.
• 401(k) savings and investment plan with a 50% employer match on the first 6% of employee contributions.
• Choice Time Off for vacation, personal needs, and sick time; new hires receive up to 20 days per calendar year, with the amount varying by years of service.
• Up to 11 paid holidays per calendar year.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior