On-Device Research Engineer

Hark • San Jose, CA

61d • $120,000 - $300,000

About The Position

We are looking for an On-Device Research Engineer to compress large audio and multimodal models into student models that meet the size, latency, and power budgets of our shipping hardware. This role sits between training and production. You will take teacher models from our research pipeline and produce student models that run on DSP, NPU, and microcontroller targets across our product line. You will own distillation, quantization, and architecture-aware compression as a first-class work-stream.

Requirements

• 3+ years of professional experience in model compression, distillation, quantization, or efficient deep learning
• Strong fluency in PyTorch or TensorFlow and modern compression libraries
• Hands-on experience taking models from full precision to fixed-point or int8 with controlled accuracy loss
• Comfort working close to hardware and reasoning about compute, memory bandwidth, and power as design constraints
• Track record of producing models that have shipped to constrained devices
• Solid foundation in audio or sequence model architectures (CNNs, transformers, RNN-T, conformers)

Nice To Haves

• Experience with Hexagon DSP, NPUs, Ambiq class MCUs, or similar
• Experience with knowledge distillation at scale, including teacher-ensemble or multi-stage distillation
• Familiarity with neural architecture search and hardware-aware NAS
• Background shipping voice-first or far-field audio products
• Contributions to open-source compression toolchains (TFLite, ONNX Runtime, AIMET, and similar)

Responsibilities

• Design and execute distillation strategies (response, feature, and self-distillation) to compress teacher models into deployable students
• Apply quantization (PTQ and QAT), pruning, and architecture search to hit per-product size, latency, and power budgets
• Build a reusable distillation and compression toolchain that the broader audio ML team can adopt across model families
• Partner with the broader audio ML team on training pipelines and with the runtime team on deployment targets
• Define accuracy retention and resource KPIs per product and track them through the release cycle
• Profile compressed models on target hardware and iterate with DSP and runtime engineers on bottlenecks

Benefits

• The US base salary range for this full-time position is between $120,000 - $300,000 annually.
• The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience.
• The total compensation package may also include additional components/benefits depending on the specific role.
• This information will be shared if an employment offer is extended.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed