Data Infrastructure Engineer
About The Position
As a Data Infrastructure Engineer, you will build the backend and hardware architecture that allows us to do high-quality and fast research. You'll be owning our entire data lifecycle, from building pipelines that process massive multimodal datasets (video, audio, text, time-series) to provisioning and managing both cloud and bare metal compute clusters we use to train on it. You will be powering our foundational model training by bridging the gap between physical neuro hardware and our central repositories, working alongside world-class researchers to ensure they have a high-throughput, low-latency pipeline straight to the GPUs.
Requirements
- Have 3+ years of production software engineering experience with deep expertise in systems-level architecture and languages like Python, Rust, C++, or Go.
- Have built and maintained high-performance ETL pipelines capable of processing, buffering, and storing terabytes of daily unstructured data.
- Are comfortable architecting, provisioning, and maintaining bare-metal local compute clusters, storage servers, and high-speed networking for intensive ML workloads.
- Have a background in handling continuous, highly concurrent data streams from heterogeneous hardware peripherals without data loss.
- Are capable of working across hybrid environments to define storage topologies, manage databases (TimescaleDB, ClickHouse), and sync massive datasets between on-premise edge servers and the cloud (AWS/GCP/Azure).
- Enjoy owning the entire technical lifecycle of infrastructure, from optimizing low-level I/O bound operations to production deployment.
Nice To Haves
- A deep understanding of modern ML frameworks (PyTorch/TensorFlow) and know how to build datasets that maximize and saturate GPU utilization.
- Experience managing networking for distributed GPU training (InfiniBand, RoCE) or optimizing zero-copy networking and shared memory.
- Built infrastructure involving programmatic video processing (FFmpeg, GStreamer, OpenCV)
Benefits
- Competitive equity compensation at a seed stage startup
- Options for housing support
- Visa sponsorship
- 3% 401k matching
- Health insurance
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
