Senior Engineering Manager, AI

AlphaSense

2d•$275,000 - $375,000

About The Position

AlphaSense is seeking a Senior Engineering Manager to lead the AI Platform team. This team is responsible for building and operating the core AI Gateway, which serves as a high-throughput pathway for all Large Language Model (LLM) traffic across the AlphaSense ecosystem. The ideal candidate will have extensive experience leading high-performance teams, a strong background in distributed system architecture, and familiarity with multi-vendor integrations. Excellent communication and strategic collaboration skills are essential for managing stakeholder expectations across the R&D organization.

Requirements

Strong track record of managing and growing high-performing teams of senior and staff engineers.
Passion for developing technical leaders and aligning engineering objectives with business strategy.
Seasoned background in designing, building, and operating high-throughput, low-latency distributed systems (specifically handling complex routing, caching, queueing, or rate limiting).
Ability to deeply engage in high-level architectural discussions, provide constructive technical direction, and deliver high-impact feedback during architectural reviews.
Exceptional communication and partnership skills to align diverse engineering, product, and executive partners across the R&D organization.
Active embrace of AI tools in developer workflows, with an expectation for the team to leverage AI in their toolchains to maximize engineering velocity.

Nice To Haves

Experience in the applied AI space or working with frameworks and tools such as LangChain, LangGraph, LiteLLM, or OpenRouter.
Experience with orchestrators and proxies like Temporal, Envoy, or similar enterprise-grade gateway technologies.
Experience with Python, Java, and highly distributed caching/queueing systems.

Responsibilities

Manage, mentor, and grow a highly talented team of up to 10 senior and staff software engineers, primarily distributed across North America.
Foster a high-performance culture focused on technical excellence, predictable delivery, and career growth.
Own the strategy and architecture of the enterprise AI Gateway, currently processing up to 1 Trillion LLM tokens per week with projected 10x growth, ensuring high availability, sub-millisecond routing, caching, queueing, and robust fallback mechanisms.
Strategically guide the integration, evaluation, and management of over 6 major LLM vendors and 50+ distinct models, optimizing for latency, cost, and reliability.
Partner closely with product management, AI research teams, and executive engineering leads to align the gateway's roadmap with core product features and organizational goals.
Define and champion software engineering best practices, architectural standards, and token-based cost-tracking telemetry across the AI Platform organization.