Build and maintain scalable search infrastructure services and microservices that power search experiences across machine learning and platform teams. Design and operate high-throughput data pipelines that consume and produce to messaging queues (e.g. Kafka), integrating with chunking, embedding, and fine-grained access control services across the platform. Build and manage thousands of OpenSearch indices across large-scale clusters, owning the full index lifecycle including creation, schema design, optimization, archival, and deletion. Improve the performance, scalability, and observability of search infrastructure, including query latency, indexing throughput, cluster health, and relevance pipelines. Deliver deadline-sensitive work regularly that is interdependent with other engineering teams, including those owning embedding, chunking, and access control services. Own search infrastructure features from intake and design through rollout and ongoing operations, and regularly influence the search infrastructure roadmap. Drive reliability and operability improvements across the search platform, including index lifecycle management policies, capacity planning, and cluster scaling strategies. This is a highly collaborative, in-person role working cross-functionally with Core, ML, and Platform engineering teams to deliver robust, production-grade search capabilities.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior