Senior Member of Technical Staff, RAG

Cohere - New York, NY

Full-time - Senior

New York, NY

Professional, Scientific, and Technical Services

About the position

As a Senior Member of Technical Staff at Cohere, you will play a pivotal role in shaping the future of AI-powered products. This senior position involves leading a diverse team of engineers to design, build, and scale AI systems that support our suite of developer-centric enterprise products. You will translate cutting-edge research into high-performance products, ensuring they meet the unique needs of our users while driving the enterprise forward.

Responsibilities

• Lead a small, diverse team of engineers in designing, building, and scaling AI systems.
• Drive the development of high-performing and secure language models tailored to user needs.
• Research and experiment with novel ideas on supercomputing and data infrastructure.
• Collaborate with researchers and engineers to create and evaluate data for post-training LLMs.
• Engage with the latest AI and deep learning research, attending leading conferences.
• Leverage product data to understand usage patterns and identify areas for improvement.
• Work closely with leadership to shape company strategy and goals.

Requirements

• Extremely strong software engineering skills.
• Proficiency in Python and related ML frameworks such as Tensorflow, TF-Serving, JAX, and XLA/MLIR.
• Deep experience in building and leading a product-centric organization.
• Direct experience working on Large Language Models.
• Strong track record of creating and curating large-scale datasets.
• Experience using large-scale distributed training strategies.
• Familiarity with autoregressive sequence models, such as Transformers.
• Ability to collaborate effectively with human annotators and cross-functional teams.
• Published papers at top-tier venues such as NeurIPS, ICML, ICLR.

Nice-to-haves

• Experience in a startup environment.
• Strong leadership and team-building skills.
• A passion for AI and continuous learning.

Benefits

• An open and inclusive culture and work environment.
• Weekly lunch stipend, in-office lunches & snacks.
• Full health and dental benefits, including a separate budget for mental health.
• 100% Parental Leave top-up for 6 months for employees in Canada, the US, and the UK.
• Personal enrichment benefits towards arts and culture, fitness and well-being, quality time, and workspace improvement.
• Remote-flexible work options with offices in Toronto, New York, San Francisco, and London.
• 6 weeks of vacation.