Senior Architect, Data Engineering

West Monroe•Los Angeles, NY

19d

About The Position

West Monroe is seeking a Senior Architect to join its Technology and Experience Practice. The role works with clients to develop Big Data strategies and roadmaps across industries including healthcare, financial services, insurance, consumer and industrial products, and energy and utilities. The Senior Architect advises on data platform selection, designs data architectures and processing pipelines, and delivers scalable AI/ML and Generative AI solutions using modern data platforms. The role also guides consultants, coordinates with client application owners, supports business development, and helps develop proposals and technical demonstrations. Travel to client sites may be required, estimated at 30% to 50%.

Requirements

At least 10 years of professional experience, including at least 5 years within a consulting ecosystem.
Very strong technical expertise in Databricks and/or Snowflake, including modern lakehouse architecture, performance optimization, governance, orchestration, and enabling AI/ML and Generative AI workloads.
Experience with AI frameworks and services such as Azure OpenAI, OpenAI APIs, LangChain, Semantic Kernel, MLflow, Mosaic AI, or comparable technologies.
Hands-on experience with large language models, prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation architectures.
Knowledge of standard methodologies, concepts, best practices, and procedures in a Big Data environment.
Experience developing or architecting modern distributed architectures using modern messaging patterns and tools.
Strong data engineering experience, including Databricks, Snowflake, and/or Microsoft Fabric.
Experience with relational databases such as Microsoft SQL Server and large unstructured data sets.
Strong experience with ETL procedures and developing ETL approaches from scratch.
Experience using cloud platforms such as AWS, Azure, or GCP.
Experience with reporting tools such as Power BI and Tableau.
Working knowledge of or experience with Azure SQL, Azure Data Lake, or Azure Data Factory.
Excellent organizational, verbal, and written communication skills.
Commitment to inclusion and diversity, and openness to new ideas and perspectives.
Proven experience supporting business development, including identifying client needs, crafting technical solutions, contributing to proposals, and participating in pre-sales activities to drive revenue growth.

Responsibilities

Provide guidance and platform-selection advice for Databricks, Snowflake, and/or Microsoft Fabric.
Design data flow and processing pipelines for analytics using modern tools such as Spark on Scala, Storm, Flume, and Sqoop.
Design data structures for ingestion and reporting based on use cases and technology.
Advise clients on data management requirements, data architecture, platform selection, and design, including data structure, stewardship, semantics and syntax of data attributes, coding structures, and mapping schemes.
Architect and implement scalable AI/ML and Generative AI solutions using modern data platforms such as Databricks, Snowflake, and Microsoft Fabric.
Design data architectures that support AI/ML workloads through high-quality, governed, secure, and scalable data pipelines and lakehouse environments.
Guide and coach consultants, share best practices, and perform code reviews.
Coordinate with data-source application owners to support integration with analytics platforms and source systems.
Ensure data integrity issues are addressed.
Attend and liaise in meetings necessary to perform duties and support business and technical development.
Partner with business development teams to identify client needs, propose tailored solutions, and build long-term stakeholder relationships that support growth.
Collaborate on proposals, presentations, and technical demonstrations that showcase architecture solutions and align with client objectives.
Travel to client sites as needed, approximately 30% to 50%.