Senior Developer - AI Software Engineer

Neuberger Berman • New York, NY

7d • Hybrid

About The Position

We are seeking a talented Mid-Level AI Software Engineer to join our growing Private Markets AI team. In this role, you will design, develop, and deploy AI-powered capabilities that drive real business impact. You will work closely with business stakeholders, engineering, and data engineering teams to build scalable, production-grade AI systems. This is an exciting opportunity to shape the next generation of intelligent products while growing your expertise in a collaborative and innovative environment.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Machine Learning, or a related quantitative field.
• 7+ years of professional experience building and deploying software applications and 2+ years focusing on AI production environments.
• Strong proficiency in Python and AI frameworks such as LangChain and LangGraph
• Hands-on experience with LLMs designing production grade agentic workflows
• Experience working with cloud platforms (AWS or Azure) and associated AI capabilities such as MCP
• Understanding of architecting enterprise agentic systems
• Solid understanding of software engineering principles including version control (Git), CI/CD, testing, and containerization (Docker).
• Strong problem-solving skills and the ability to translate ambiguous business requirements into technical solutions.

Nice To Haves

• Experience in Private Markets or related financial sector
• Familiarity with AI infrastructure tools such as Azure AI Foundry and AWS Bedrock
• Experience with large language models, prompt engineering, fine-tuning techniques (LoRA, RLHF), and retrieval-augmented generation (RAG).
• Familiarity with vector databases (Pinecone, Weaviate, Chroma) and embedding-based search systems.
• Experience building real-time inference systems or streaming AI pipelines.

Responsibilities

• Evaluate, design and, architect AI Tooling for production use cases within the Private Markets business solving real-world business problems
• Build and maintain end-to-end AI powered solutions covering data ingestion, feature engineering, model training, evaluation, and deployment.
• Integrate large language models (LLMs) and foundation models into product features, including prompt engineering, fine-tuning, and RAG architectures.
• Partner with the Private markets business users to design and build agentic workflows
• Collaborate with data engineers to ensure high-quality, well-structured training datasets and feature stores.
• Write clean, well-tested, and well-documented code following engineering best practices.
• Participate in code reviews, design discussions, and knowledge-sharing sessions with the broader engineering team.
• Stay current with advances in AI/ML research and evaluate emerging tools, frameworks, and techniques for adoption.

Benefits

• We offer a comprehensive package of benefits including paid time off, medical/dental/vision insurance, retirement, life insurance and other benefits to eligible employees.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 501-1,000 employees