Databricks Solutions Architect Associate Director

Protiviti • Chicago, IL

13d • Hybrid

About The Position

Protiviti is looking for a Technology Consulting Associate Director to join our growing Enterprise Data & Analytics team. As an Associate Director, you'll take a lead role in strengthening our relationships with clients and providing seamless guidance in the completion of engagements. You'll partner with our strategic clients to manage risk associated with their use of technology. You'll develop strategies to solve complex business problems using new ways of thinking, and devise solutions to support your clients' needs through analytics, automation or the latest tools and methods. You’ll develop new projects, help identify new business, and build lasting relationships with clients and within the community as you serve as an ambassador of Protiviti in the market. You will also be a mentor and provide growth and development to teams as you oversee the successful completion of project work plans.

Requirements

• Experience with many and familiarity with most of the following Concepts and Methodologies:
• Advanced skills in architecting future state data solutions using Well-Architected Frameworks aligned to Databricks.
• Experience in planning and migrating data solutions from various sources, including on-premises, other cloud platforms, or legacy systems, to Databricks.
• Highly proficient with implementing ETL processes and databases using either Databricks or complimentary solutions.
• Significant experience optimizing existing data implementations, including pipelines, queries, and data models, to enhance performance and delivery of value to the business.
• Knowledge of administering and maintaining data solutions to ensure stability, security, scalability, and affordability.
• Highly proficient in data engineering, including data movement, data integration, transformation, and cleansing.
• Ability to lead designing, managing, and optimizing data warehousing / modern data platform.
• Highly skilled in data modeling, including entity-relationship diagrams, dimensional modeling, and semantic modeling.
• Ability to perform data analytics, including exploratory data analysis and leveraging data for actionable insights.
• Experience with implementing data governance frameworks and policies, including an understanding of managing data assets using Unity Catalog.
• Understanding of data security practices, including encryption and access control.
• Knowledge of networking as it applies to configuring Databricks on-prem or within cloud solutions.
• Understanding of DevOps or DataOps concepts and experience with the deployment of Databricks solutions.
• Expert in SQL and Spark (PySpark & Spark SQL).
• Competency with at least 3 and exposure to most of these technologies: Databricks Lakehouse architecture and medallion design patterns, Unity Catalog governance, lineage, access controls, and data sharing, Apache Spark development using PySpark, Spark SQL, and Delta Lake, Data engineering with Auto Loader, Lakeflow Declarative Pipelines, and workflow orchestration, Databricks Asset Bundles, Git integration, CI/CD, and environment promotion, Databricks SQL, serverless compute, query optimization, and performance tuning.
• Leadership and direct supervisory experience of teams including conducting performance appraisals, mentoring and coaching, oversight and review of work, coordination across teams, and understanding how to motivate.
• Bachelor’s degree in a relevant discipline (e.g., MIS, CIS, Analytics).
• 9+ years working in professional services or related industry.
• Professional Databricks certification (Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional).

Nice To Haves

• Familiarity with programming languages such as C#, Java, Scala, R, DAX, MDX, or M.
• Experience with Data Science and/or Machine Learning.
• Experience with Mosaic AI, MLflow, model serving, and generative AI capabilities.
• Databricks Champion.

Responsibilities

• Design and deliver modern data engineering solutions with Databricks.
• Build trusted relationships with C-level executives and provide exceptional experiences that translate to additional project work.
• Promote a positive team culture that fosters open communication among all engagement team members.
• Create development opportunities for others, including participating in the creation and rollout of training, and ways for your team to improve our clients and communities.
• Discover prospective project work with current and potential clients through networking, knowledge-building, and client interactions.
• Identify opportunities to integrate product solutions and resources to improve client service capabilities.
• Translate client challenges into new project proposals and sales.
• Serve as a valued contributor to thought leadership and encourage knowledge-sharing and collaboration across teams.
• Manage a diverse portfolio of clients across industries.
• Articulate the value of Databricks capabilities to customers and colleagues.
• Guide decision-making through data storytelling.
• Formulate, communicate, and execute data strategies that align with organizational goals and objectives leveraging Databricks and relevant technologies.
• Assess existing data solutions, whether on-premises or in the cloud, to inform improvement initiatives.
• Architect future state data solutions using Well-Architected Frameworks aligned to Databricks.
• Plan and migrate data solutions from various sources to Databricks.
• Implement ETL processes and databases using Databricks or complimentary solutions.
• Optimize existing data implementations, including pipelines, queries, and data models.
• Administer and maintain data solutions to ensure stability, security, scalability, and affordability.
• Lead designing, managing, and optimizing data warehousing / modern data platform.
• Perform data analytics, including exploratory data analysis and leveraging data for actionable insights.
• Implement data governance frameworks and policies, including managing data assets using Unity Catalog.
• Understand data security practices, including encryption and access control.
• Configure Databricks on-prem or within cloud solutions, considering networking aspects.
• Deploy Databricks solutions using DevOps or DataOps concepts.
• Establish and cultivate business relationships and a professional network, including with senior executives.
• Pursue business development opportunities and identify and implement strategies to obtain new work or clientele.
• Translate and communicate issues, risks or challenges to client personnel, including executives.
• Provide leadership and direct supervisory experience of teams, including conducting performance appraisals, mentoring and coaching, oversight and review of work, coordination across teams, and understanding how to motivate.

Benefits

• Medical coverage
• Dental coverage
• Vision coverage
• FSA and HSA healthcare accounts
• Life and accident insurance
• Adoption and fertility assistance
• Paid parental leave up to 10 weeks
• Short/long term disability
• Company 401(k) savings and investment plan with an employer match of 50% on the first 6% of your contributions.
• Choice Time Off (CTO) for vacation, personal needs, and sick time (New hires receive up to 20 days of CTO per calendar year).
• 11 paid holidays each calendar year.

What This Job Offers

• Job Type: Full-time
• Career Level: Director