Senior Associate - AI Engineer

New York Life Insurance Co•New York, NY

126d•$114,401 - $142,900•Hybrid

About The Position

New York Life’s AI and Data team delivers innovative data, insights, and AI solutions across the organization. Our AI team works on a diverse portfolio of AI and Generative AI initiatives, combining agile and entrepreneurial drive with industry-leading methods and tools. Our efforts are fully supported by executive leadership, and we partner closely with business stakeholders throughout the full model lifecycle—from ideation through production deployment. Because delivering AI solutions to production requires multiple skill sets, our team includes product managers, data scientists, AI engineers, program managers, model validation and governance professionals, and communications and development specialists. In this role, you will collaborate with Data Scientists and Platform Engineers to design and deliver AI and GenAI solutions for business partners. You will influence architecture, implementation standards, and engineering best practices to ensure scalable, secure, and production-ready AI systems.

Requirements

5+ years of software engineering experience, including at least 2 years of hands-on experience implementing AI/ML solutions
Strong experience with API development and engineering best practices
Proficiency in Python
Experience implementing AI/GenAI patterns (e.g., RAG, MCP, agentic workflows) using frameworks such as LangChain or LangGraph
Experience with machine learning libraries and frameworks such as scikit-learn, TensorFlow, PyTorch, or Keras
Understanding of containerization technologies (Docker) and Linux environments
Strong knowledge of data structures, algorithms, and core software engineering principles
Experience with SQL and big data platforms such as Postgres, Redshift, or Databricks
Experience working in AWS or similar cloud compute environments using cloud-native tools
Experience working in Agile/Scrum environments
Passion for technology transformation, innovation, and continuous improvement

Nice To Haves

Professional experience working with Generative AI in production environments
Experience implementing and managing vector databases
Experience with Kubernetes and container orchestration
Exposure to Model Context Protocol (MCP) servers
Experience with advanced natural language processing (NLP) tools and frameworks such as SpaCy, NLTK, or Hugging Face

Responsibilities

Design and develop production-grade AI and Generative AI solutions
Ensure all AI code adheres to software engineering best practices and coding standards
Implement models with scalability, observability, monitoring, and debugging in mind
Set up and manage ML experiments, including server-based hyperparameter tuning
Partner with Platform Engineers to develop pipelines and tools that automate model deployment
Collaborate on solution architecture and implementation decisions
Develop solution architectures that integrate ML models into enterprise systems
Prototype and evaluate new AI technologies and capabilities
Collaborate with product managers, data scientists, and engineers across the organization
Conduct code reviews to ensure solutions are well-designed, secure, and maintainable
Stay current on emerging AI technologies and identify opportunities to enhance the platform
Apply knowledge of Large Language Models (LLMs) and their enterprise use cases