Senior Software Engineer, AI

North • New York, NY

93d • $230,000 - $270,000 • Hybrid

About The Position

We're looking for a Sr. Software Engineer, AI to own the machine learning and AI efforts across our platform. You'll work directly with our CTO to define and build AI-powered features that will shape Agent North, our customer-facing AI assistant, as well as drive advancements in cost and usage forecasting, financial modeling, and multi-service provider rightsizing. This is a hands-on, senior-level role, perfect for someone who thrives in a fast-moving startup environment, has built ML-powered products before, and is comfortable taking a project from 0 to 1. If you're a high-energy, motivated engineer passionate about LLMs, cloud infrastructure, and deploying AI systems at scale, we'd love to hear from you.

Requirements

• 5+ years of hands-on experience in ML, AI model development, and infrastructure deployment.
• Experience deploying ML models at scale on AWS (cloud-based, distributed systems, or edge deployments).
• Strong programming skills in Python and SQL, with demonstrated ability to write production-quality code.
• Proficiency with ML frameworks and the judgment to determine when and where to apply them based on data complexity.
• Ability to move fast and iterate, taking ideas from concept to production.
• Comfortable with Git.
• Excellent communication skills, with the ability to clearly convey progress, methodology, solution approach, and results.
• Strong analytical background, capable of sifting through complex cost patterns and making sense of intricate financial cloud modeling.

Nice To Haves

• Experience working in a startup.
• Experience working with financial cloud data across GCP, AWS, or Azure, or complex large financial and logging datasets.
• Experience deploying models in Amazon Bedrock or on AWS.
• Experience deploying infrastructure with Terraform.
• AWS technical certification (or equivalent cloud certification).

Responsibilities

• Design, build, and deploy ML models for cloud automation and optimization.
• Work with LLMs, fine-tuning, optimizing, and integrating them into our platform.
• Develop AI chatbots and customer-facing AI solutions to automate and enhance cloud finance management.
• Ensure security and compliance in AI model deployment, implementing best practices for secure AI infrastructure.
• Set up and maintain ML infrastructure across GCP, AWS, and Azure, optimizing for scale and efficiency.
• Drive ML project development from 0 to 1, making key decisions on architecture, tooling, and implementation.
• Collaborate with engineering, product, and leadership teams to align AI development with business goals.
• Experiment with and implement cutting-edge ML techniques, including prompt engineering, model security, continuous evaluation, and monitoring frameworks.
• Provide thought leadership, driving AI strategy and identifying opportunities to improve and expand North's AI capabilities.

Benefits

• Unlimited PTO
• 16 weeks of paid parental leave (birthing parents receive an additional 4 weeks at 50% pay)
• Two company-wide breaks per year: one around Labor Day and one at the end of the year
• Aetna Medical PPO plan with the majority of the premium covered by North
• Dental and vision insurance
• Flexible spending account (FSA) for health expenses and commuter benefits
• 30 day sabbatical every 4 years

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed