Member of Technical Staff, Search/Retrieval Expert

xAI • East Palo Alto, CA

105d • $180,000 - $440,000

About The Position

xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All engineers are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates. The foundation team at xAI is dedicated to building the infrastructure and systems that empower maximum truth-seeking AI agents. To achieve this, we are developing AI-first search/retrieval systems that enable LLM agents to efficiently access, process, and leverage vast knowledge bases — ultimately fostering agents that prioritize accuracy, rigorous reasoning, and an unbiased pursuit of knowledge. We are seeking expert engineers to architect and scale retrieval/search systems for data in all modalities (text, images, video, and audio) to elevate agent reasoning and decision-making.

Requirements

• Strong engineering background with a passion for building high-performance search systems that contribute to truthful AI.
• Expertise in information retrieval, vector embeddings, and semantic search technologies.
• Familiar with distributed systems, large-scale indexing, and optimizing query latency in ML contexts.
• Experience working with LLMs, agents, or knowledge-intensive tasks, including fine-tuning for retrieval tasks aimed at enhancing truthfulness.
• Proficient in managing and curating large datasets from diverse sources, with a focus on quality, verifiability, and efficiency to support maximum truth-seeking agents.

Nice To Haves

• Extensive experience in building and scaling search engines, including hands-on involvement in production systems and experimental iterations.

Responsibilities

• Developing and optimizing search pipelines for LLM agents at scale, with a core goal of supporting maximum truth-seeking capabilities.
• Designing efficient search algorithms and indexing strategies for trillion-scale datasets across modalities.
• Integrating search systems with xAI's core models to improve accuracy, speed, and relevance in real-time agent interactions, ensuring agents can discern and prioritize truthful information.
• Experimenting with advanced techniques like dense retrieval and hybrid search to minimize biases and hallucinations.
• Ensuring robustness and scalability of search infrastructure under high-load conditions while aligning with truth-seeking objectives.

Benefits

• Equity
• Comprehensive medical coverage
• Vision coverage
• Dental coverage
• Access to a 401(k) retirement plan
• Short & long-term disability insurance
• Life insurance
• Various discounts and perks

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 11-50 employees