Backend Engineer

Hark • San Jose, CA

84d • $170,000 - $400,000

About The Position

Hark is an artificial intelligence company building advanced, personalized intelligence. One that is proactive, multimodal, and capable of interacting with the world through speech, text, vision, and persistent memory. We're pairing that intelligence with next-generation hardware to create a universal interface between humans and machines. While today's AI largely operates through chat boxes and decade-old devices, Hark is focused on what comes next: agentic systems that interact naturally with people and the real world. To get there, we're developing multimodal models and next-generation AI hardware together - designed from the ground up as a single, unified interface for a new era of intelligent systems.

You'll build the backend systems that make Hark's AI agent actually work — reliable, fast, and production-grade. That means the hard infrastructure problems: high-concurrency services, low-latency streaming, state management for long-running agent workflows, and the execution layer that connects model outputs to real-world actions. You are building the nervous system of an agentic product. This is a high-ownership role on a small team. You'll work directly with model researchers and platform engineers, and the systems you build will determine whether Hark feels like a slow chatbot or something genuinely new.

Requirements

• 5+ years of experience building mission-critical backend systems. You are an expert in concurrency, networking protocols, and distributed systems.
• Proven track record of shipping APIs and infrastructure that handle real-world traffic, with a deep understanding of horizontal scaling and "day 2" operations.
• Experience integrating LLMs into backend pipelines. You understand the unique failure modes of non-deterministic systems and how to wrap them in deterministic, reliable code.
• Strong experience in at least one systems-level language (e.g., Go, Rust, C++, or Java).
• Comfort with cloud-native architectures (AWS/GCP), container orchestration, and building secure, isolated execution sandboxes.
• Ability to articulate complex architectural tradeoffs and collaborate with model researchers to bridge the gap between AI and production-grade software.

Nice To Haves

• Hands-on experience with gRPC, WebSockets for high-performance streaming.
• Prior work with vector databases, distributed caching, or custom memory management systems.
• Deep knowledge of Kubernetes, microservices security, or serverless execution patterns.
• Experience building developer-facing APIs or SDKs.

Responsibilities

• Design and build the high-concurrency backend services responsible for agent orchestration, tool execution, and real-time streaming.
• Develop robust failure-handling, retry logic, and state management for long-running agentic workflows.
• Architect the foundational APIs and services—including memory retrieval systems and sandboxed execution environments—that power the entire Hark ecosystem.
• Optimize the stack for low-latency streaming and high-throughput data processing to ensure seamless agent-user interactions.
• Lead features from low-level design and prototyping to production deployment, monitoring, and performance tuning.
• Implement deep instrumentation and automated evaluation frameworks to track system health and model quality regressions.

Benefits

• The US base salary range for this full-time position is between $170,000 - $400,000 annually.
• The pay offered for this position may vary based on several individual factors, including job-related knowledge, skills, and experience.
• The total compensation package may also include additional components and benefits depending on the specific role.
• This information will be shared if an employment offer is extended.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed