Software Engineer, Data Infrastructure

Cohere • New York, NY

1d • Hybrid

About The Position

We're building the data infrastructure behind some of the most demanding AI training workloads in the world, and we want sharp, curious people to help us do it. In this role, you'll build and maintain the high-performance data layer our Modeling teams rely on for training and evaluation jobs. As a Software Engineer, Data Infrastructure, you will work directly on petabyte-scale storage infrastructure, and the networking and performance challenges that come with it. You will collaborate daily with researchers and engineers who are some of the best in the world at what they do.

Requirements

• 4+ years of experience working on data storage infrastructure
• Strong command of Python
• Kubernetes experience, especially on the storage side (Persistent Volumes, CSI drivers, etc.)
• The ability to transform unstructured data into performant datasets across diverse storage backends including S3, GCS, and POSIX
• Experience with distributed data processing frameworks such as Apache Beam, Spark, or Flink

Nice To Haves

• Familiarity with modern analytics tooling such as BigQuery, Airflow, or dbt
• Genuine excitement about AI. You follow the research, have opinions, and enjoy being in the weeds
• Comfort operating at the edge of what's known, with a desire to build something genuinely new rather than optimize what already exists

Responsibilities

• Work directly on petabyte-scale storage infrastructure, and the networking and performance challenges that come with it.
• Collaborate daily with researchers and engineers who are some of the best in the world at what they do.

Benefits

• An open and inclusive culture and work environment
• Work closely with a team on the cutting edge of AI research
• Weekly lunch stipend, in-office lunches & snacks
• Full health and dental benefits, including a separate budget to take care of your mental health
• 100% Parental Leave top-up for up to 6 months
• Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement
• Remote-flexible, offices in Toronto, New York, San Francisco, London and Paris, as well as a co-working stipend
• 6 weeks of vacation (30 working days!)

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed