Senior Architect, Data Engineering

West Monroe•Washington, DC

1d•$183,800 - $244,700•Hybrid

About The Position

West Monroe is seeking a Senior Architect to join their Technology and Experience Practice. This role involves working with clients on Big Data strategy and roadmaps across various industries such as Healthcare, Financial Services, Insurance, Consumer & Industrial Products, and Energy & Utilities.

Requirements

10+ years of professional experience and 5+ within consulting ecosystem.
Very strong technical expertise in Databricks and/or Snowflake including modern lakehouse architecture, performance optimization, governance, orchestration, and enablement of AI/ML and Generative AI workloads.
Experience with modern AI frameworks and services such as Azure OpenAI, OpenAI APIs, LangChain, Semantic Kernel, MLflow, Mosaic AI, or comparable technologies.
Hands-on experience with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures.
Knowledge of standard methodologies, concepts, best practices, and procedures within a Big Data environment.
Development of or architecture of modern distributed architectures using modern messaging patterns and tools.
Strong data engineering experience with the following core competencies:
Experience with Databricks, Snowflake, and/or Fabric.
Experience working with relational databases (Microsoft SQL Server) and working with large unstructured data sets.
Strong experience with ETL procedures and ideation from scratch.
Experience using cloud platforms such as AWS, Azure, GCP etc.
Experience with reporting tools such as PowerBI and Tableau.
Working knowledge or experience working with Azure SQL, Azure Data Lake or Azure Data Factory.
Excellent organizational, verbal and written communication skills.
A commitment to inclusion and diversity, and openness to new ideas and perspectives.
Proven experience in supporting business development efforts, including identifying client needs, crafting technical solutions, contributing to proposals, and participating in pre-sales activities to drive revenue growth.
Travel to client sites as needed (30% to 50%).

Responsibilities

Provide guidance and platform selection advice for Databricks, Snowflake, and/or Microsoft Fabric.
Design data flow and processing pipelines for analysis using modern toolsets such as Spark on Scala, Storm, Flume, Sqoop.
Design data structures for ingestion and reporting, specific to use case and technology.
Provide data management expertise to clients in evaluating requirements and developing data architecture and performing platform selection and design. Data management includes appropriate structuring, stewardship of data, semantics/syntax of data attributes, coding structures, and mapping schemes.
Architect and implement scalable AI/ML and Generative AI solutions leveraging modern data platforms such as Databricks, Snowflake, and Microsoft Fabric.
Design data architectures that enable AI/ML workloads through high-quality, governed, secure, and scalable data pipelines and lakehouse environments.
Guide and coach consultants, share best practices, perform code reviews.
Coordinate activities with data source application owners to ensure integration with analytics platform and source systems.
Ensure that data integrity issues are addressed.
Liaise and attend meetings necessary to perform duties and aid business and technical development.
Partner with business development teams to identify client needs, propose tailored solutions, and build long-term relationships with key stakeholders to drive growth opportunities.
Collaborate on crafting compelling proposals, presentations, and technical demonstrations that showcase innovative architecture solutions and align with client objectives to win new business.