AI Solution Engineer

Colgate • Piscataway, NJ

2d • Hybrid

About The Position

The AI Solution Engineer selects implementation approaches that fit business problems and works across React, JavaScript/TypeScript, Python or Node.js, SQL, cloud services, APIs, AI frameworks, and shared enterprise services. The role focuses on strong full-stack engineering, applied AI capability, sound technical judgment, and ownership of reliable production software.

The engineer designs, builds, deploys, and supports enterprise applications and workflows using LLMs and agents to address business needs. They translate product requirements and user needs into scalable technical designs and measurable outcomes, integrate applications with enterprise systems and approved AI services, and apply secure, responsible engineering practices. The role includes prototyping, testing and evaluating AI features, monitoring production performance, improving applications based on usage and quality measures, and collaborating with product, design, architecture, business, AI platform, data, and security partners.

Requirements

• Bachelor’s degree in computer science, software engineering, information systems, data science, artificial intelligence, or a related technical field, or equivalent practical experience.
• At least 4 years of professional software engineering experience, including demonstrated full-stack application development and production support.
• Strong JavaScript/TypeScript, React, HTML/CSS, Python or Node.js, SQL, and web-application engineering skills.
• Strong knowledge of REST/GraphQL APIs, JSON, webhooks, asynchronous workflows, data modeling, and enterprise integration patterns.
• Working knowledge of LLM APIs, prompt/context engineering, RAG, embeddings, vector search, tool/function calling, agents, structured outputs, evaluations, and guardrails.
• Hands-on experience with JavaScript/TypeScript and React or a comparable modern front-end framework.
• Hands-on experience with at least one back-end language, preferably Python, along with SQL and API development.
• Experience integrating applications with relational or document databases, cloud services, authentication systems, and enterprise APIs.
• Experience with Git, CI/CD, automated testing, observability, secure development, and production troubleshooting.

Nice To Haves

• Relevant cloud, software engineering, security, data, or AI certifications.
• Experience delivering business-facing applications from technical design through deployment and ongoing operation.
• Experience with an AI application or agent orchestration framework, such as LangGraph, Google ADK, Semantic Kernel, or an equivalent technology.
• Practical experience building with LLMs or other AI services, including prompt engineering, RAG, vector databases, agents, tool calling, evaluation, or model monitoring.

Responsibilities

• Design, build, deploy, and support full-stack enterprise applications and workflows that use LLMs and agents to solve business problems.
• Translate product requirements and ambiguous user needs into scalable technical designs, implementation plans, and measurable outcomes.
• Build responsive, accessible user experiences using JavaScript/TypeScript, React, HTML/CSS, component frameworks, and modern web-development practices.
• Develop back-end services, APIs, workflows, business logic, and data-access layers using Python, Node.js/TypeScript, SQL, REST, GraphQL, and cloud-native services.
• Implement AI capabilities such as prompt and context design, retrieval-augmented generation, semantic/vector search, tool/function calling, structured outputs, agents, and human-in-the-loop workflows.
• Integrate applications with enterprise systems, databases, data platforms, identity providers, approved model endpoints, and shared AI platform services.
• Create AI evaluation approaches for correctness, groundedness, safety, task completion, user experience, latency, and cost.
• Apply secure engineering practices for authentication, authorization, least privilege, secrets, data privacy, auditability, and responsible AI.
• Build automated unit, integration, end-to-end, performance, and AI-specific tests.
• Implement deployment automation, monitoring, logs, traces, metrics, alerts, and support procedures for reliable production operation.
• Create reusable components, services, connectors, patterns, and documentation to improve delivery speed and engineering consistency.
• Measure application adoption, quality, reliability, user satisfaction, and business value, and use results to improve products.
• Partner with product managers, designers, architects, business stakeholders, AI Platform Engineers, data teams, and security teams to refine requirements and solution designs.
• Develop and review front-end and back-end code, APIs, database queries, workflows, AI features, prompts, tool definitions, and integrations.
• Prototype new experiences where uncertainty is high, then harden validated approaches for enterprise production use.
• Write and maintain tests, evaluation datasets, documentation, architecture diagrams, runbooks, and support materials.
• Participate in design reviews, code reviews, threat modeling, sprint planning, backlog refinement, releases, incident response, and retrospectives.
• Monitor application health, model behavior, retrieval quality, latency, cost, usage, and failures; diagnose issues and prioritize improvements.
• Address defects, security findings, performance problems, dependency updates, operational issues, and technical debt.
• Evaluate new application and AI technologies against user needs and enterprise engineering standards.

Benefits

• Comprehensive benefits package, including medical, dental, and vision coverage.
• Basic life insurance and disability coverage.
• Paid parental leave.
• Participation in the 401(k) retirement plan with company matching contributions, subject to eligibility requirements.
• Minimum of 15 vacation/PTO days for salaried employees.
• 13 paid holidays.
• Paid sick leave adjusted based on role and location in accordance with local laws.
• Salaried employees may be eligible for discretionary bonuses and profit-sharing.
• Long-term incentives for Executive-level roles.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level