Sr. Product Analyst - AI Administrator

LPL Financial Services•San Diego, CA

40d

About The Position

The AI Administrator evaluates the ongoing performance of AI-powered tools. As part of this, the AI Administrator identifies improvements needed to enhance AI tools and works with Product Managers and Business Owners to outline requirements and a plan for the work so it can be prioritized. The AI Administrator works with the product, technology, and subject matter experts from the business to ensure the successful release of the new functionality and supports communication across the organization.

Requirements

A degree in Computer Science Data Science, or a related field (or equivalent experience).
1 year of Generative AI tools and methodologies, including models like GPT, BERT, and other transformer-based models.
1 plus years experience Microsoft excel proficiency
A track record of innovative thinking and problem solving.
Demonstrated ability to work independently and collaboratively with all levels of staff and management across multiple partner teams.
Ability to evaluate and optimize AI-powered tools for high-quality outputs and performance.
Ability to effectively respond to dynamically changing work environments and to positively influence business outcomes.
Strong analytical skills with the ability to collect, organize, analyze information with attention to detail and accuracy.
Team-oriented individual with the ability to quickly assimilate and apply new concepts, possess flexible attitude, and manage ambiguity.
Ability to work across functional teams to drive outcomes without having direct authority.
Become a trusted business partner and user advocate to get things done with high responsiveness.
Serve as one of the recognized subject matter experts of AI-powered tools within multiple platforms supported by this team.

Nice To Haves

2+ years financial industry experience.
Certifications or training in AI, machine learning, or NLP.
Strong understanding of Large Language Models (LLMs) and their applications in financial industry scenarios.
Hands-on experience with Retrieval-Augmented Generation (RAG) techniques for combining generative and retrieval-based approaches in AI systems.
Familiarity with Sentiment Analysis techniques to assess and interpret user inputs.

Responsibilities

Represent Product and Technology while engaging with vendors and LPL stakeholders.
Partner with Product Managers to drive improvements through each phase of the Product Management Lifecycle.
Participate in project planning, sprint planning, demos, releases, and other Scrum-related meetings.
Organize, communicate, & execute plans to deliver improved user experiences with our AI-powered tools.
Regular monitoring, tuning, and troubleshooting of AI-powered tools to ensure optimal performance.
Outline acceptance criteria and business value for features and/or user stories when support is required from technology developers.
Keep up-to-date with the latest trends and research in AI, machine learning, and natural language processing (NLP).
Proactively identify new tools, techniques, and strategies to enhance AI capabilities within the organization.
Apply your problem-solving abilities and critical thinking skills to address challenges related to AI implementation and optimization.
Work closely with product managers, data analysts, technology developers, quality engineers, and other stakeholders to optimize AI performance within our SaaS products.
Proven track record improving and optimizing generative AI performance for search engines, including fine-tuning models for more accurate and relevant search results.
Experience evaluating and enhancing search relevance by leveraging AI models with traditional search techniques (e.g., keyword-based, semantic search, etc.)
Proven track record optimizing AI-powered chatbots, including enhancing conversational flows, automating tasks for operation efficiency, and improving user experience.
Experience evaluating and enhancing chatbot performance using metrics like response relevance, engagement, and satisfaction.
Strong skills in identifying bottlenecks in AI-powered workflows and finding innovative solutions to optimize them.