Senior Architect, Data Engineering

West Monroe•Los Angeles, NY

1d•Hybrid

About The Position

West Monroe is seeking a Senior Architect to join our thriving Technology and Experience Practice. This is an excellent opportunity to work with clients developing Big Data strategy and roadmaps, while gaining exposure to a variety of industries including Healthcare, Financial Services, Insurance, Consumer & Industrial Products, and Energy & Utilities.

Requirements

10+ years of professional experience and 5+ within consulting ecosystem
Very strong technical expertise in Databricks and/or Snowflake including modern lakehouse architecture, performance optimization, governance, orchestration, and enablement of AI/ML and Generative AI workloads
Experience with modern AI frameworks and services such as Azure OpenAI, OpenAI APIs, LangChain, Semantic Kernel, MLflow, Mosaic AI, or comparable technologies
Hands-on experience with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures
Knowledge of standard methodologies, concepts, best practices, and procedures within a Big Data environment
Development of or architecture of modern distributed architectures using modern messaging patterns and tools
Strong data engineering experience with the following core competencies:
Experience with Databricks, Snowflake, and/or Fabric
Experience working with relational databases (Microsoft SQL Server) and working with large unstructured data sets
Strong experience with ETL procedures and ideation from scratch
Experience using cloud platforms such as AWS, Azure, GCP etc.
Experience with reporting tools such as PowerBI and Tableau
Working knowledge or experience working with Azure SQL, Azure Data Lake or Azure Data Factory.
Excellent organizational, verbal and written communication skills
A commitment to inclusion and diversity, and openness to new ideas and perspectives
Proven experience in supporting business development efforts, including identifying client needs, crafting technical solutions, contributing to proposals, and participating in pre-sales activities to drive revenue growth.

Nice To Haves

Travel to client sites as needed (30% to 50%)

Responsibilities

Provide guidance and platform selection advice for Databricks, Snowflake, and/or Microsoft Fabric
Design data flow and processing pipelines for analysis using modern toolsets such as Spark on Scala, Storm, Flume, Sqoop
Design data structures for ingestion and reporting, specific to use case and technology
Provide data management expertise to our clients in evaluating requirements and developing data architecture and performing platform selection and design. Data management includes appropriate structuring, stewardship of data, semantics/syntax of data attributes, coding structures, and mapping schemes
Architect and implement scalable AI/ML and Generative AI solutions leveraging modern data platforms such as Databricks, Snowflake, and Microsoft Fabric
Design data architectures that enable AI/ML workloads through high-quality, governed, secure, and scalable data pipelines and lakehouse environments
Guide and coach consultants, share best practices, perform code reviews
Coordinate activities with data source application owners to ensure integration with analytics platform and source systems
Ensure that data integrity issues are addressed
Liaise and attend meetings necessary to perform duties and aid business and technical development
Partner with business development teams to identify client needs, propose tailored solutions, and build long-term relationships with key stakeholders to drive growth opportunities
Collaborate on crafting compelling proposals, presentations, and technical demonstrations that showcase innovative architecture solutions and align with client objectives to win new business.