Senior AI Product Engineer, Backend

Jobgether

3d • $125,000 - $225,000 • Remote

About The Position

This role offers an exciting opportunity to build and scale high-performance backend systems for AI and LLM-powered applications. You will work on distributed services, APIs, and analytics platforms that process billions of data points, enabling engineers to ship reliable and impactful AI solutions. This position blends deep technical expertise with creativity, allowing you to prototype, optimize, and implement cutting-edge algorithms in a collaborative, remote-first environment. You will directly influence product innovation, work alongside customers and cross-functional teams, and help shape the future of AI observability and evaluation. The ideal candidate thrives in high-growth, technically challenging environments and is passionate about AI, backend engineering, and building systems that scale.

Requirements

• 5+ years of experience building high-performance backend systems.
• Strong programming skills in Go, Python, Java, and/or TypeScript/Node.
• Proven experience designing and operating complex SaaS platforms or distributed systems.
• Familiarity with cloud platforms and container orchestration, such as AWS, GCP, Azure, and Kubernetes.
• Enthusiasm for AI and LLM technologies, with a drive to stay current on emerging trends.
• Experience collaborating with cross-functional teams to deliver technically complex solutions.
• Strong problem-solving skills and ability to work independently in a remote-first environment.

Nice To Haves

• Experience with distributed stream processing frameworks (Kafka, Gazette, etc.).
• Familiarity with OLAP systems or system observability tools like Prometheus.
• Knowledge of ML or data science workflows.
• Hands-on experience working with large language models or developing AI products.

Responsibilities

• Design, implement, and maintain scalable, high-performance backend services using Go, Python, Java, and TypeScript.
• Build APIs and infrastructure to support Machine Learning and LLM workflows, ensuring reliability and low-latency performance.
• Develop and maintain analytics and monitoring systems that process high-volume data streams.
• Prototype and optimize distributed services, including OLAP databases, message queues, and dimensionality reduction algorithms.
• Collaborate closely with product, design, and customer engineering teams to translate needs into backend solutions.
• Contribute to open-source frameworks and internal tools that advance platform capabilities.
• Support the development of in-house AI agents and tools that enhance ML and LLM observability.

Benefits

• Competitive salary range: $125,000–$225,000, plus equity.
• Comprehensive healthcare coverage (medical, dental, vision) and 401(k) plan.
• Unlimited paid time off and generous parental leave.
• Support for mental health and wellness initiatives.
• Remote-first work environment with optional NYC and SF offices.
• Monthly WFH stipend for co-working or home office needs.
• Opportunities to collaborate with leading AI engineers, researchers, and ethicists.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed