Open Source AI Engineer (Typescript)
About The Position
Arize AI is seeking an Open Source AI Engineer to join their growing OSS team. This role will drive the development of new frameworks, metrics, and tooling to help developers build, test, and improve LLM tasks. The engineer will play a lead role in shaping how developers measure and understand performance in advanced AI systems, all in the open. Arize AI is the leading AI observability and evaluation platform, empowering AI engineers to build and deploy high-performing, reliable models. As the AI landscape shifts from traditional ML to generative AI and agentic systems, Arize ensures teams have the tools to monitor, troubleshoot, and improve AI in production.
Requirements
- Deeply passionate about AI, loves working in the open, and thrives in a fast-paced environment where “everyone wears multiple hats”.
- Believes collaboration and community-driven development unlocks the best innovations.
- Enjoys tackling ambiguous challenges and finding elegant technical solutions.
- Values empirical results, enjoys creating or refining evaluation metrics, and iterates based on real-world feedback.
- Always learning—exploring new LLM architectures, prompt engineering strategies, or emerging library standards.
- Relishes the process of taking ideas from initial prototypes to production-ready solutions that delight users.
- Hands-on LLM Experience: Familiarity with popular LLM frameworks, prompt engineering techniques, and agent harnesses.
- Strong TypeScript Proficiency: Understands TypeScript and can write isomorphic code that executes seamlessly across clients, servers, and diverse edge runtimes.
- Open Source Track Record: Contributions to open source projects, personal GitHub repos with interesting AI demos, or a history of active engagement in developer communities.
Nice To Haves
- ML Observability & Tools: Familiarity with debugging AI applications, exploring embeddings, or building data-heavy dashboards is a plus.
Responsibilities
- Design, architect, and open-source new libraries, pipelines, and APIs that make it simpler to monitor, evaluate, and improve LLM output.
- Partner closely with the broader AI open source ecosystem, gather feedback, review pull requests, and steer the direction of the project to address real developer needs.
- Experiment with state-of-the-art LLM techniques, turning research into practical developer tooling.
- Integrate with our existing platform to surface deeper insights on LLM behavior—help teams quickly diagnose and fix issues such as hallucinations or bias.
- Write blog posts, white papers, tutorials, and documentation to help developers succeed with our open source tools and grow the LLM eval community.
Benefits
- Competitive equity package
- Medical, dental, vision
- 401(k) plan
- Unlimited paid time off
- Generous parental leave plan
- Other benefits for mental and wellness support
- WFH monthly stipend to pay for co-working spaces
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
