AI Data Scientist - Vice President
About The Position
As an AI Data Scientist, you will leverage cutting-edge LLM-first approaches to drive exploratory data analysis and rapid semantic clustering. Your expertise will be crucial in scaling prompt-based prototypes into cost-effective embedding and vector pipelines, ensuring both efficiency and accuracy. You will be responsible for driving taxonomy mapping and functional decomposition automation, transforming complex business process data into actionable insights. This role involves designing and executing evaluation experiments, with a deep understanding of prompt evaluation and automated tuning using LLM-as-a-judge frameworks. You will possess mastery of the Python ecosystem, statistical evaluation, and expertise in embeddings tuning, K-means, and graph clustering, contributing to continuous evaluation pipelines like RAGAS or TurLens. Your ability to extract meaningful patterns from terabytes of messy, undocumented legacy system logs and ticket data will be key to mapping operational workflows.
Requirements
- Mastery of prompt evaluation and automated tuning with LLM-as-a-judge frameworks.
- Deep knowledge of the Python ecosystem and statistical evaluation.
- Expertise in embeddings tuning, K-means, and graph clustering.
- Experience with continuous evaluation pipelines like RAGAS or TurLens.
- Proven ability to design dynamic routing or softmax-based thresholding pipelines to optimize LLM inference costs and accuracy.
Nice To Haves
- Experience processing large volumes of unstructured data using statistical evaluation and natural language processing.
- Contributions to retrieval or chunking modules of major frameworks.
Responsibilities
- Utilize LLM-first approaches for exploratory data analysis and rapid semantic clustering.
- Scale prompt-based prototypes into cost-effective embedding and vector pipelines.
- Drive taxonomy mapping and functional decomposition automation.
- Execute evaluation experiments, focusing on prompt evaluation and automated tuning with LLM-as-a-judge frameworks.
- Contribute to continuous evaluation pipelines such as RAGAS or TurLens.
- Process and analyze terabytes of diverse data, including legacy system logs, to map operational workflows.
- Contribute code to retrieval or chunking modules of major frameworks like LlamaIndex or LangChain.
Benefits
- A diverse and inclusive environment that embraces change, innovation, and collaboration
- A hybrid working model, allowing for in-office / work from home flexibility, generous vacation, personal and volunteer days
- Employee Resource Groups support an inclusive workplace for everyone and promote community engagement
- Competitive compensation packages including health and wellbeing benefits, retirement savings plans, parental leave, and family building benefits
- Educational resources, matching gift and volunteer programs
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
Number of Employees
5,001-10,000 employees
