Senior Consultant

EXL • Jersey City, NJ

2d

About The Position

We are seeking a Senior Consultant to oversee and drive the delivery of end-to-end projects focused on analytical applications and data solutions. This role requires technical leadership and mentorship to data engineering teams, guiding them on complex challenges and best practices. The Senior Consultant will collaborate with business and technical stakeholders to gather requirements, design solutions, and manage project deliverables. A key aspect of this role involves utilizing Generative AI frameworks like OpenAI, Hugging Face, or Google Vertex AI to design, deploy, and integrate cutting-edge AI/ML solutions. The position also entails managing cross-functional collaboration with Business Data Analysts (BDAs), ensuring alignment between data engineering and business goals, and taking ownership of release planning, change management, and stakeholder engagement to ensure project success. Adherence to Agile practices, including facilitating sprint planning, retrospectives, and delivery timelines, is essential.

Requirements

• Expertise in building modular, scalable, and reusable frameworks for data integration, data quality validation, and pipeline orchestration.
• Hands-on experience with LLM (Large Language Models), Agentic AI, and integration with APIs from platforms like OpenAI, Hugging Face, and AWS AI services.
• Strong background in Snowflake, SQL, DBT, and PySpark, with advanced knowledge of query optimization, CDC (Change Data Capture), and data transformation.
• Extensive experience with AWS (Glue, EMR, S3, Lambda, Redshift), Azure Data Factory, and cloud-native architectures.
• Expertise in developing event-driven and microservices-based architectures using Java, Python, and modern frameworks.
• Proficient in building CI/CD pipelines with tools like Jenkins, GitLab, and Terraform for infrastructure-as-code automation.
• Proven experience in managing Big Data platforms and implementing solutions for large-scale data ingestion, storage, and processing.
• Implementation of security best practices, including OWASP guidelines, RBAC, and vulnerability detection/remediation.
• Proven experience in building scalable data engineering frameworks and foundational services to support enterprise-wide analytics initiatives.
• Hands-on expertise in Snowflake, Spark, and AWS Glue, with knowledge of event-driven architectures and streaming data solutions.
• Strong leadership experience in managing teams and delivering complex projects in Agile environments with leading team size of more than 20 members.
• Proficiency in integrating Generative AI solutions into existing platforms and workflows.
• Excellent communication and stakeholder management skills to collaborate across diverse teams.

Responsibilities

• Oversee and drive the delivery of end-to-end projects focused on analytical applications and data solutions.
• Provide technical leadership and mentorship to data engineering teams, guiding them on complex challenges and best practices.
• Collaborate with business and technical stakeholders to gather requirements, design solutions, and manage project deliverables.
• Utilize Generative AI frameworks like OpenAI, Hugging Face, or Google Vertex AI to design, deploy, and integrate cutting-edge AI/ML solutions.
• Manage cross-functional collaboration with Business Data Analysts (BDAs), ensuring alignment between data engineering and business goals.
• Take ownership of release planning, change management, and stakeholder engagement to ensure project success.
• Ensure adherence to Agile practices, facilitating sprint planning, retrospectives, and delivery timelines.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed