Data Scientist II

LivePerson

19h•$120,000 - $145,000•Remote

About The Position

At LivePerson, the Data Scientist II helps advance Conversational AI by applying research and experimentation with Large Language Models (LLMs) to real-world customer interactions. This role designs and executes applied research initiatives, develops effective prompting and orchestration strategies using deep knowledge of transformer architectures, and optimizes modern LLM inference and retrieval pipelines. The scientist analyzes large-scale conversational datasets to improve Retrieval-Augmented Generation (RAG) systems and builds robust experimentation frameworks for evaluating non-deterministic model outputs. Working closely with other scientists and cross-functional teams, this role translates insights on model behavior into recommendations that inform product and business strategy while staying at the forefront of Generative AI advancements.

Requirements

Requires a Master's degree in Computer Science, Artificial Intelligence, Computational Linguistics, Operations Research, Industrial Engineering, or a directly related field plus two (2) years of experience as a data scientist.
Must have two (2) years of experience in the following (experience may be gained concurrently): Programming experience in Python
Developing and designing Large Language Model (LLM) interaction flows, evaluation frameworks, or advanced prompting strategies
Partnering with engineering teams to deploy GenAI/LLM solutions into production
Must have one (1) year of experience in the following (experience may be gained concurrently): Experience with Generative AI, including Large Language Models, Prompt Engineering, Retrieval Augmented
Researching and implementing advanced prompting techniques, such as Chain-of-Thought or Few-Shot prompting
Experience with dialogue systems and context management
Hands on experience with LLM Orchestration Frameworks, such as LangChain / LangGraph
Experience with Transformer architectures, specifically understanding Attention mechanisms, Context Windows, and Tokenization constraints
Experience with SQL

Responsibilities

Propose, plan, and execute applied research initiatives that will make a real-world impact on Conversational AI using Large Language Models (LLMs) within a commercial setting.
Use expert knowledge of Transformer architecture mechanics (Attention, Tokenization, Embeddings) to consistently find the most effective, efficient, stable, explainable, and elegant prompting and orchestration approaches.
Utilize modern LLM inference and retrieval pipelines.
Analyze large scale conversational datasets for RAG (Retrieval-Augmented Generation) optimization.
Bring research-inspired prompt strategies to life within production systems.
Create durable, flexible scientific evaluation and experimentation capabilities for non-deterministic model outputs.
Present findings on model behavior and context efficacy in ways that inform and guide business and product strategy.
Work closely with other scientists.
Stay current with the rapidly evolving state of Generative AI.

Benefits

Medical, Dental, and Vision Insurance: Comprehensive plans to support your health needs.
Wellness Resources: Access to wellbeing resources and programs including our EAP plan.
Health & Mental Support: Access a confidential and free Employee Assistance Program (EAP), providing professional counseling.
401(k) Retirement Plan: To help you plan for your financial future by offering both the plan and a 4% employer match (100% match on the first 3% contribution and 50% match on the next 2% contribution)
HSA & FSA Plans: To help you plan for health related expenses on a pre-tax basis
Employee Stock Purchase Program (ESPP): Participate and receive a discount on company shares, allowing you to directly share in LivePerson's success and growth.
Additional Insurances: Basic and supplemental life insurance, Accidental Death & Dismemberment (AD&D) insurance, long-term and short-term disability insurance coverage, legal plan, identity theft protection plan, and critical illness supplemental insurance.
Development: Access to internal professional development resources.
Flexible Paid Time Off (PTO): Discretionary PTO package for flexible days off with manager approval.
Paid Public Holidays.
Generous Parental Leave Policy: Including maternity/paternity support and fertility services.
Remote-First Model: This role is fully remote (#LI-Remote), offering excellent work-life balance and flexibility. We also maintain dedicated WeWork space for those who wish to meet colleagues or collaborate in person.