Member of Technical Staff - Pre-Training

xAI•Palo Alto, CA

3h•$180,000 - $440,000

About The Position

xAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.

Requirements

Strong systems skills in configuring and troubleshooting complex distributed data processing systems for maximum performance.
Building bespoke data processing systems from scratch.
Preparing pre-training and post-training data for state-of-the-art large language models and generative models.
Organizing and meticulously bookkeeping data across multiple clouds, of multiple modalities, and from many sources.

Responsibilities

Design and implement petabyte-scale, high-throughput data processing systems that involve both CPU- and GPU-based processing.
Design and implement tools for orchestrating complex data pipelines.
Design and implement innovative tools for improving data discoverability and data quality at scale for both pre-training and post-training across different modalities.
Build, run, and manage innovative data pipelines for creating high-quality training data.