Staff Software Engineer, AI

BlackLine • New York, NY

7h • Hybrid

About The Position

As an AI Staff Engineer you'll play a crucial role in developing and refining our product’s AI. You'll report directly to our VP of Engineering and work closely with our engineering and product teams to enhance our AI capabilities and drive innovation in our fin-tech AI platform.

Requirements

• 4+ years of experience as a Full Stack Software Engineer or a similar role developing, shipping, and testing of software within a well-established enterprise, bonus points if at a fast growth enterprise
• Bachelor’s degree in Computer Science, Engineering or a related field
• Demonstrated experience working with production LLM APIs (OpenAI, Anthropic, Google, etc.) including handling rate limits, cost optimization, and performance monitoring in live systems (not just vibe coding)
• Clear experience utilizing frameworks like RAG in production applications to further enhance the foundational models for proprietary applications and datasets
• Experience with AI system testing methodologies including model evaluation, A/B testing of AI features, and monitoring model performance in production
• Experience with data pipelines and ETL/ELT processes (given our data-intensive AI workflows)

Nice To Haves

• Understanding of data privacy and security best practices particularly in the age of AI
• Experience with model deployment and MLOps practices
• Understanding of AI cost optimization and performance tuning
• Experience with vector databases and embedding systems
• Strong track record of experience with backend development in Java
• Strong proficiency in front-end technologies (e.g. JavaScript, React)
• Strong analytical and problem-solving skills
• Experience in fin-tech or financial services industry a plus

Responsibilities

• Utilize the best-in-class models available on the market to deliver meaningful solutions for our clients, bringing them from the idea stage all the way to production
• Collaborate with the team to integrate AI solutions into our existing production processes
• Design and implement scalable AI system architecture handling including model orchestration, caching strategies, and fallback mechanisms
• Evaluate and implement new AI technologies and methodologies to keep WiseLayer and BlackLine at the cutting edge

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 1,001-5,000 employees