Senior Architect, Data Engineering

West Monroe•Washington, DC

20d•$183,800 - $244,700

About The Position

West Monroe is seeking a Senior Architect to join its Technology and Experience Practice. The role works with clients on Big Data strategy and roadmaps across industries including healthcare, financial services, insurance, consumer and industrial products, and energy and utilities. The Senior Architect provides data-management expertise, advises on modern data platform selection, and designs scalable data architectures, data flows, and processing pipelines. The position also architects and implements AI/ML and Generative AI solutions, guides and coaches consultants, and collaborates with client and internal teams on delivery and business development.

Requirements

10 or more years of professional experience, including at least 5 years within a consulting ecosystem.
Strong technical expertise in Databricks and/or Snowflake, including modern lakehouse architecture, performance optimization, governance, orchestration, and enablement of AI/ML and Generative AI workloads.
Experience with modern AI frameworks and services such as Azure OpenAI, OpenAI APIs, LangChain, Semantic Kernel, MLflow, Mosaic AI, or comparable technologies.
Hands-on experience with large language models, prompt engineering, embeddings, vector databases, and retrieval-augmented generation architectures.
Knowledge of standard methodologies, concepts, best practices, and procedures in a Big Data environment.
Experience developing or architecting modern distributed architectures using modern messaging patterns and tools.
Strong data engineering experience, including experience with Databricks, Snowflake, and/or Fabric.
Experience with relational databases such as Microsoft SQL Server and with large unstructured data sets.
Strong experience with ETL procedures and developing ETL approaches from scratch.
Experience using cloud platforms such as AWS, Azure, or GCP.
Experience with reporting tools such as Power BI and Tableau.
Working knowledge of or experience with Azure SQL, Azure Data Lake, or Azure Data Factory.
Excellent organizational, verbal, and written communication skills.
Commitment to inclusion and diversity, and openness to new ideas and perspectives.
Proven experience supporting business development, including identifying client needs, crafting technical solutions, contributing to proposals, and participating in pre-sales activities to drive revenue growth.
Willingness to travel to client sites as needed (30% to 50%).

Responsibilities

Provide guidance and platform selection advice for Databricks, Snowflake, and/or Microsoft Fabric.
Design data flows and processing pipelines for analysis using modern tools such as Spark on Scala, Storm, Flume, and Sqoop.
Design data structures for ingestion and reporting according to the use case and technology.
Evaluate client requirements and develop data architecture, including platform selection and design, data structuring and stewardship, data semantics and syntax, coding structures, and mapping schemes.
Architect and implement scalable AI/ML and Generative AI solutions using modern data platforms such as Databricks, Snowflake, and Microsoft Fabric.
Design data architectures that enable AI/ML workloads through high-quality, governed, secure, and scalable data pipelines and lakehouse environments.
Guide and coach consultants, share best practices, and perform code reviews.
Coordinate with data source application owners to ensure integration between analytics platforms and source systems.
Ensure data integrity issues are addressed.
Attend and participate in meetings necessary to perform duties and support business and technical development.
Partner with business development teams to identify client needs, propose tailored solutions, and build long-term stakeholder relationships to drive growth.
Help craft proposals, presentations, and technical demonstrations that showcase architecture solutions, align with client objectives, and support winning new business.