Databricks Solutions Architect Senior Manager

Protiviti • Chicago, IL

1d • $149,000 - $239,000 • Hybrid

About The Position

Protiviti is looking for a Technology Consulting Senior Manager to join our growing Enterprise Data & Analytics team. As a Senior Manager, you’ll partner with our clients to identify and manage risk. You'll develop strategies to solve complex business problems using new ways of thinking, and devise solutions to support your clients' needs through using the latest tools and methods. You’ll develop lasting relationships with client personnel and further these relationships through quality product delivery. You’ll foster a network within the business community and serve as an ambassador of Protiviti in the market. You will also be a mentor and provide performance development to teams as you oversee the successful completion of project work plans.

Requirements

• 7+ years working in in professional services or related industry.
• Bachelor’s degree in a relevant discipline (e.g., MIS, CIS, Analytics)
• Professional Databricks certification (Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional)
• Expert in SQL and Spark (PySpark & Spark SQL)
• Competency with at least 3 and exposure to most of these technologies: Databricks Lakehouse architecture and medallion design patterns, Unity Catalog governance, lineage, access controls, and data sharing, Apache Spark development using PySpark, Spark SQL, and Delta Lake, Data engineering with Auto Loader, Lakeflow Declarative Pipelines, and workflow orchestration, Databricks Asset Bundles, Git integration, CI/CD, and environment promotion, Databricks SQL, serverless compute, query optimization, and performance tuning
• Leadership and direct supervisory experience of teams including conducting performance appraisals, mentoring and coaching, oversight and review of work, coordination across teams, and understanding how to motivate.

Nice To Haves

• Familiarity with most of the following Concepts and Methodologies: Ability to articulate the value of Databricks capabilities to customers and colleagues, and proven track record of data storytelling to guide decision-making. Participation in the process of formulating, communicating, and executing data strategies that align with organizational goals and objectives leveraging Databricks and relevant technologies. Experience in assessing existing data solutions, whether on-premises or in the cloud, to inform improvement initiatives. Advanced skills in architecting future state data solutions using Well-Architected Frameworks aligned to Databricks. Experience in planning and migrating data solutions from various sources, including on-premises, other cloud platforms, or legacy systems, to Databricks. Highly proficient with implementing ETL processes and databases using either Databricks or complimentary solutions. Significant experience optimizing existing data implementations, including pipelines, queries, and data models, to enhance performance and delivery of value to the business. Knowledge of administering and maintaining data solutions to ensure stability, security, scalability, and affordability. Highly proficient in data engineering, including data movement, data integration, transformation, and cleansing. Ability to lead designing, managing, and optimizing data warehousing / modern data platform. Highly skilled in data modeling, including entity-relationship diagrams, dimensional modeling, and semantic modeling. Ability to perform data analytics, including exploratory data analysis and leveraging data for actionable insights. Experience with implementing data governance frameworks and policies, including an understanding of managing data assets using Unity Catalog. Understanding of data security practices, including encryption and access control. Knowledge of networking as it applies to configuring Databricks on-prem or within cloud solutions. Understanding of DevOps or DataOps concepts and experience with the deployment of Databricks solutions. Bonus for familiarity with any of the programming languages such as C#, Java, Scala, R, DAX, MDX, or M. Bonus: Experience with Data Science and/or Machine Learning. Bonus: Mosaic AI, MLflow, model serving, and generative AI capabilities
• Familiarity with programming languages such as C#, Java, Scala, R, DAX, MDX, or M.
• Experience with Data Science and/or Machine Learning.
• Experience with Mosaic AI, MLflow, model serving, and generative AI capabilities.
• Databricks Champion.

Responsibilities

• Designing and delivering modern data engineering solutions with Databricks.
• Learning and staying updated on data architecture and engineering, including the latest trends and developments with Databricks.
• Building relationships with clients and providing exceptional experiences.
• Project management and team leadership.
• Promoting a positive team culture that fosters open communication among all engagement team members.
• Creating development opportunities for others, including participating in the creation and rollout of training, and ways for your team to improve our clients and communities.
• Contributing to the preparation of client proposals and strategies to win new business.
• Identifying opportunities to integrate product solutions and resources to improve client service capabilities.
• Working with a diverse portfolio of clients across industries.
• Articulating the value of Databricks capabilities to customers and colleagues, and proven track record of data storytelling to guide decision-making.
• Participating in the process of formulating, communicating, and executing data strategies that align with organizational goals and objectives leveraging Databricks and relevant technologies.
• Assessing existing data solutions, whether on-premises or in the cloud, to inform improvement initiatives.
• Architecting future state data solutions using Well-Architected Frameworks aligned to Databricks.
• Planning and migrating data solutions from various sources, including on-premises, other cloud platforms, or legacy systems, to Databricks.
• Implementing ETL processes and databases using either Databricks or complimentary solutions.
• Optimizing existing data implementations, including pipelines, queries, and data models, to enhance performance and delivery of value to the business.
• Administering and maintaining data solutions to ensure stability, security, scalability, and affordability.
• Data engineering, including data movement, data integration, transformation, and cleansing.
• Designing, managing, and optimizing data warehousing / modern data platform.
• Data modeling, including entity-relationship diagrams, dimensional modeling, and semantic modeling.
• Performing data analytics, including exploratory data analysis and leveraging data for actionable insights.
• Implementing data governance frameworks and policies, including an understanding of managing data assets using Unity Catalog.
• Understanding of data security practices, including encryption and access control.
• Networking as it applies to configuring Databricks on-prem or within cloud solutions.
• Understanding of DevOps or DataOps concepts and experience with the deployment of Databricks solutions.
• Evaluating, summarizing, organizing, and interpreting data.
• Establishing and cultivating business relationships and a professional network, including with senior executives.
• Successfully pursuing business development opportunities and identifying and implementing strategies to obtain new work or clientele.
• Translating and communicating issues, risk, or challenges to client personnel, including executives.
• Leadership and direct supervisory experience of teams including conducting performance appraisals, mentoring and coaching, oversight and review of work, coordination across teams, and understanding how to motivate.

Benefits

• Medical coverage
• Dental coverage
• Vision coverage
• FSA and HSA healthcare accounts
• Life insurance
• Accident insurance
• Adoption assistance
• Fertility assistance
• Paid parental leave up to 10 weeks
• Short-term disability
• Long-term disability
• Company 401(k) savings and investment plan with an employer match of 50% on the first 6% of your contributions
• Choice Time Off (CTO) for vacation, personal needs, and sick time
• Up to 20 days of CTO per calendar year for new hires
• Up to 11 paid holidays each calendar year

What This Job Offers

• Job Type: Full-time
• Career Level: Senior