Harman International-posted 7 months ago
$21 - $38/Yr
Full-time • Intern
Remote • Bellevue, WA
Food and Beverage Retailers

We are hiring an Intern - LLM Testing Framework to join our AI/ML innovation team focused on building a robust testing and validation framework for large language models (LLMs) used in enterprise applications. This is an individual contributor role ideal for someone passionate about generative AI and looking to gain hands-on experience in AI quality assurance, prompt engineering, and model evaluation. You'll work closely with solution architects and senior AI engineers to shape how LLMs are tested, monitored, and improved in real-world enterprise workflows.

  • Assist in developing a structured testing framework for LLM-based enterprise applications
  • Help define and execute test plans for accuracy, hallucination detection, bias analysis, and fail-safe behavior
  • Simulate real-world user prompts and multi-turn conversations to evaluate LLM consistency and reliability
  • Support in setting up dashboards, logging tools, and structured evaluation protocols
  • Contribute to the creation of synthetic datasets, reusable test templates, and prompt variations
  • Foundational understanding of LLMs and prompt engineering concepts
  • Proficiency in Python; exposure to testing tools or automation libraries is a plus
  • Familiarity with AI evaluation metrics and techniques (e.g., precision, recall, hallucination scoring)
  • Strong analytical mindset and structured approach to testing and documentation
  • Curiosity to explore new AI tools and eagerness to contribute to applied research
  • Pursuing a Bachelor's or Master's degree in Computer Science, Data Science, or related fields
  • Experience with LLM toolkits like LangChain, Semantic Kernel, or vector databases
  • Previous project or internship experience in AI, automation testing, or enterprise applications
  • Awareness of ethical AI practices or experience with model governance frameworks
  • Comfort with reading technical papers or contributing to open-source tools
  • Flexible work environment, allowing for full-time remote work globally for positions that can be performed outside a HARMAN or customer location
  • Access to employee discounts on world-class Harman and Samsung products (JBL, HARMAN Kardon, AKG, etc.)
  • Extensive training opportunities through our own HARMAN University
  • An inclusive and diverse work environment that fosters and encourages professional and personal development
  • Paid sick leave and medical benefits
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service