Software Engineer – AI Platform New York City | Private Credit

J Harlan Group•New York, NY

1d•Onsite

About The Position

Our client is one of the leading private credit investment firms in the United States, managing more than $9 billion in assets and providing bespoke financing solutions to middle-market companies. The firm has built a production AI platform that is transforming how investment professionals research, analyze, and evaluate investment opportunities. The platform powers AI-generated investment memoranda, due diligence questionnaire (DDQ) automation, and intelligent retrieval across highly complex financial and legal documents. Our client is seeking an exceptional Software Engineer to help expand this platform and build the next generation of AI-enabled investment workflows. This is an opportunity to build production AI systems that become part of the daily workflow of investment professionals making real investment decisions. As one of a small number of engineers supporting this platform, you'll have significant ownership, influence technical direction, and see your work move quickly from concept to production. Working alongside the platform's lead engineer, you'll partner directly with investment professionals, investor relations, and operations teams to design, build, deploy, and continuously improve AI-powered applications that deliver measurable business impact. If you're passionate about solving challenging engineering problems, shipping production software, and leveraging cutting-edge AI technologies to solve real-world business problems, this is an exceptional opportunity.

Requirements

3–5 years of professional software engineering experience.
Strong programming experience in one or more of the following: Python, TypeScript / JavaScript, Go, Rust
Experience building production AI applications using technologies such as: AI Agents, Retrieval-Augmented Generation (RAG), Vector Search, Prompt & Context Engineering, Evaluation Frameworks (Evals)
Daily experience using AI-assisted development tools such as: Claude, Code Cursor, Codex, GitHub Copilot or similar AI-native development environments
Demonstrated success independently designing, building, deploying, and supporting production software.
A builder's mindset with a passion for solving difficult technical problems and delivering high-quality software.
Strong verbal and written communication skills with the ability to work directly with senior business stakeholders.
Excellent analytical, organizational, and problem-solving skills.
Applicants must be legally authorized to work in the United States on a full-time basis. Sponsorship or transfer of employment visas are not available for this position.

Nice To Haves

Document-intensive or highly regulated industries
Financial Services
Private Credit
Banking or Capital Markets
Asset Management
Investment Banking
Vector databases (Qdrant, Pinecone, Weaviate, or similar)
PDF and document parsing
Anthropic or OpenAI APIs
Agent SDKs
Model Context Protocol (MCP)
Programmatic document generation (DOCX/PPTX)
Open-source software development

Responsibilities

Design, develop, deploy, and support production AI applications that support the investment lifecycle.
Build and enhance AI agents, reusable skills, subagents, and workflow automation.
Develop provenance tracking, citation, and review capabilities that improve confidence in AI-generated output.
Build scalable retrieval pipelines utilizing vector search and modern RAG architectures.
Collaborate closely with investment, investor relations, and operations professionals to understand business workflows and deliver practical AI solutions.
Own projects from architecture and design through implementation, deployment, testing, monitoring, and ongoing production support.
Participate in architectural discussions and help shape the future direction of the firm's AI platform.