Sr. Machine Learning Engineer

Canoe Intelligence • New York, NY

91d • $180,000 - $220,000

About The Position

We are looking for a Senior Machine Learning Engineer to design and deploy models that make sense of highly complex, unstructured financial documents, enabling us to deliver data with unprecedented accuracy, speed, and trust. You’ll work hands-on with LLM and other ML Models, helping scale Canoe’s platform while shaping how alternative investment firms interact with their data.

Requirements

• Minimum of 5 years of experience in applied ML engineering, with a focus on NLP, information extraction, or LLMs.
• Proficiency in Python and relevant machine learning libraries (e.g., TensorFlow, PyTorch).
• Strong understanding of MLOps (Docker, Kubernetes, CI/CD for ML, experiment tracking).
• Proficiency with AI-assisted development tools (e.g., GitHub Copilot, Claude Code agent) to accelerate software development, prototyping, testing, and deployment of ML solutions.
• Problem-solver with a product mindset and bias toward outcomes.
• Excellent communication skills; able to partner across engineering, product, and business teams.
• Comfortable in fast-paced, agile startup environments.
• Bachelor’s degree in computer science or related field.

Nice To Haves

• Master Degree or PhD in computer science or related field.
• Experience in training and deploying large language models.
• Familiarity with cloud computing platforms and distributed computing.
• Familiarity with modern ML Ops tools such as Modal, Weights and Biases, Sagemaker, etc.
• Experience with LLM fine-tuning techniques such as LoRA, QLoRA, or parameter-efficient training frameworks (e.g., Unsloth).

Responsibilities

• Design, train, and evaluate ML models for document classification, entity extraction, summarization, and information retrieval.
• Fine-tune and optimize large language models for domain specific use cases, optimizing their performance for accuracy, efficiency, and scalability.
• Work closely with data engineering teams to preprocess and engineer features from large datasets to enhance the performance of machine learning models.
• Build scalable, production-ready ML services with strong observability, monitoring, and retraining capabilities.
• Contribute to Canoe’s MLOps stack, including CI/CD for models, feature stores, evaluation frameworks, and data versioning.
• Collaborate with product managers, software engineers, and other stakeholders to integrate machine learning models into end-to-end solutions.
• Stay current with advancements in LLMs, Agentic AI, and ML, and translate new research into practical improvements to Canoe’s technology stack.
• Conduct code reviews to ensure code quality and provide mentorship to junior members of the machine learning team.

Benefits

• Medical, dental, vision benefits
• Flexible PTO
• 401(k)
• Flexible work from home policy
• Home office stipend
• Employee Assistance Program
• Gym/Wifi reimbursement
• Education assistance
• Parental Leave

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Bachelor's degree