Machine Learning Engineer (Live Agent & Post-Processing) - San Francisco

Plaud • San Francisco, CA

22h • Hybrid

About The Position

Plaud is building the world's most trusted AI work companion for professionals, elevating productivity and performance through note-taking solutions, and is loved by over 1,500,000 users worldwide since 2023. Their mission is to amplify human intelligence by building the next-generation intelligence infrastructure and interfaces to capture, extract, and utilize what people say, hear, see, and think. Plaud Inc. is a Delaware-incorporated, San Francisco-based company pushing the boundary of human–AI intelligence through a hardware–software combination, committed to the highest standards of data security and privacy protection with SOC 2, HIPAA, GDPR, ISO27001, ISO27701, and EN18031 compliance. Joining Plaud means being part of a bootstrapped, skyrocketing, profitable company with a $250M revenue run rate achieved in just three years. You will define the next-gen paradigm for human-AI interaction, gain exposure to cutting-edge AI for Pro tools, and play a direct role in global expansion. The company offers a culture that champions continuous learning and fast career development, market-competitive compensation, global exposure, and a vibrant, creativity-fueled work atmosphere.

Requirements

• 1–3 years of experience of hands-on experience in speech algorithm training with a focus on speech pre/post-processing or the optimization of Full-Duplex voice interaction systems.
• Proven experience in ASR pre-processing (e.g., VAD, denoising) or post-processing (e.g., ITN, punctuation, text normalization).
• A track record of publishing at top-tier speech conferences (e.g., Interspeech, ICASSP) or a portfolio of speech-related invention patents.

Responsibilities

• Design and iterate on "post-processing" test suites and automated evaluation platforms for multilingual, multi-model online systems, covering hallucinations, casing, formatting (numbers/punctuation), and segmentation (chunking/forced breaks).
• Establish specialized evaluation benchmarks for LiveAgent systems, focusing on VAD false triggers, interruption latency, and turn-taking transitions.
• Resolve "high-friction" issues—such as hallucinations, casing inconsistencies, and poor segmentation—that negatively impact user experience, achieving SOTA precision on par with industry leaders.
• Optimize VAD, barge-in (interruption) models, and turn-taking strategies to minimize end-to-end latency and False Interruption Rates, benchmarking against top-tier global voice assistants.

Benefits

• Opportunity to join the founding team of this new initiative, with meaningful ownership and impact on a fast-growing startup.
• Competitive Compensation: $150K-$240K base salary+performance bonus+Equity.
• Comprehensive Benefits: Top-tier healthcare for employees and dependents, including dental and vision, and a generous employer subsidy.
• Retirement Planning: 401(k) plan for full time employees with company matching.
• Paid Time Off: Unlimited PTO, plus 13 paid holidays.
• New Parent Leave: 12 weeks of paid time off to spend time with your new family, regardless of gender.
• Hybrid Office: Minimum of 3x in office per week.
• Gear: New hires are equipped with their choice of new top-of-the-line laptops and workstation setups.
• Perks: Best office equipment. Annual offsites. Free office drinks and snacks.

What This Job Offers

• Job Type: Full-time
• Career Level: Entry Level
• Education Level: No Education Listed