The Core Engineering-L2-New York-Vice President-Software Engineering

Goldman Sachs • New York, NY

6h

About The Position

The Core Engineering Shared Services AI team operates as an internal forward-deployed AI engineering function, embedding with The Core business teams to identify priority workflows, prototype agentic AI solutions, and productionize cloud-native applications that deliver measurable business impact. This hands-on role combines client-facing problem discovery, rapid engineering execution, production AI architecture, and structured transition to receiving teams that will operate and extend the solutions over time. As an AI Application Engineer, you will work directly with internal business and engineering partners to convert ambiguous operating problems into secure, reliable AI products. You will define where agents should act, where they should assist, and where human approval or control gates are required, then design and deliver solutions that are adopted in real workflows and can be supported in production.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related quantitative field.
• 9+ years of hands-on software engineering experience building, deploying, and supporting robust production applications.
• Strong proficiency in Python, Java, or Go, with demonstrated ability to apply sound software engineering, testing, data modelling, and system design practices.
• Proven experience translating complex business requirements into cloud-optimized application architectures, scalable data models, and technical specifications for production delivery.
• Experience operating in a forward-deployed or internal client-facing engineering model, including workflow discovery, stakeholder engagement, rapid prototyping, solution shaping, pilot execution, adoption measurement, and production handoff to receiving teams.
• Extensive experience with major cloud platforms such as AWS, Azure, or GCP, including serverless, containerization, managed services, automated deployment, monitoring, and cloud security standards.
• Experience designing cloud-based AI solution architectures that integrate managed AI services, LLM providers, retrieval and vector search, secure data access, API gateways, event-driven workflows, identity and entitlement controls, observability, deployment automation, and cost and resilience trade-offs across AWS, Azure, or GCP.
• Demonstrated experience integrating LLM or AI/ML capabilities into production applications, including RAG pipelines, embeddings, vector databases or search indexes, prompt templates, context assembly, structured outputs, response validation, evaluation datasets, and model performance monitoring.
• Excellent communication and collaboration skills, with the ability to engage technical and non-technical stakeholders, lead cross-functional delivery, and enable receiving teams through documentation, mentoring, and knowledge transfer.

Nice To Haves

• Experience building agentic AI systems that decompose tasks, plan multi-step workflows, call approved tools or APIs, maintain state, enforce permission and policy checks, handle failure paths, and produce auditable action trails.
• Experience implementing agent observability and controls, including trace capture, prompt and tool-call logging, hallucination and policy-violation checks, human-in-the-loop approvals, incident handoff, and post-action summarization.
• Experience optimizing production AI systems through model selection and routing, prompt compression, retrieval tuning, caching, batching, streaming responses, asynchronous execution, parallel tool calls, latency budgets, cost controls, and quality regression testing.

Responsibilities

• Lead the design, build, deployment, and operationalization of cloud-native AI applications, using modern software engineering practices, CI/CD pipelines, and automated testing to accelerate reliable delivery.
• Partner with business and engineering teams to identify high-impact AI opportunities, translate requirements into cloud-optimized architectures, and define scalable data models and technical specifications.
• Embed with The Core business teams to map workflows, identify pain points, assess agentic automation opportunities, define control and approval boundaries, iterate with users, and drive adoption through pilots, feedback loops, and measurable outcomes.
• Build AI applications using LLM APIs, retrieval-augmented generation, embeddings, vector search, prompt and context management, structured outputs, response validation, and evaluation harnesses required for production use.
• Apply cloud-native services, secure deployment patterns, observability, lifecycle management, and MLOps practices to ensure applications are scalable, resilient, cost-aware, and supportable.
• Document solutions, mentor receiving teams, and support clean transition of application code, integration patterns, data models, and operational practices into long-term engineering ownership.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior