AI Platform Context Lead ID84742

AgileEngine • New York, NY

13d

About The Position

AgileEngine is an Inc. 5000 software company that creates software for Fortune 500 brands and startups across more than 17 industries. The AI Platform Context Lead will build and maintain the context and knowledge layer behind an enterprise AI ecosystem, combining knowledge-graph design, semantic retrieval, RAG, and agent integrations across Slack, Google Workspace, Glean, and AI assistants. The role improves answer quality through evaluation, governance, and reusable self-service patterns.

The position owns ongoing context and knowledge-graph quality, including schema, coverage, freshness, and retrieval quality. It partners with subject-matter experts and teams to design and maintain agents, skills, prompts, workflows, integrations, and discovery tools. The role also administers enterprise platforms, ensures security and organizational alignment, develops evaluation and operational practices, and drives improvements in reliability, search quality, and cost efficiency.

Requirements

• Authorized to work for any employer in the United States; the company is unable to sponsor or take over employment visa sponsorship.
• At least 6 years of experience in development roles, including hands-on experience as a Tech Lead.
• Experience designing and/or owning a knowledge graph or enterprise context/retrieval architecture end to end.
• Demonstrated experience building production-quality AI agents, skills, or integrations using MCP, function calling, RAG, and enterprise search.
• Ability to distinguish wrong retrieval from correct retrieval with missing context in evaluation traces, and prioritize fixes by business impact.
• Hands-on experience administering or engineering enterprise SaaS, search, or AI platforms, such as Slack, Google Workspace, Glean, Claude, or ChatGPT.
• Strong systems-administration background, including identity and access management, configuration, monitoring, and incident response.
• Experience working across multiple business functions and turning pre-project discovery questions into checklists others can use independently.
• Strong troubleshooting, technical-writing, and stakeholder-communication skills, with the ability to lead through influence without direct authority.
• Upper-intermediate English level.

Responsibilities

• Design, curate, and continuously improve the company context and knowledge graph, including its schema, coverage, freshness, and retrieval quality.
• Review agent and skill outputs to identify missing or incorrect context, and prioritize fixes according to business impact.
• Coordinate cross-team work so systemic context gaps are resolved architecturally rather than repeatedly patched.
• Partner with subject-matter experts to design, build, test, and maintain AI agents, skills, prompts, and workflows using MCP, function calling, and comparable frameworks.
• Determine whether a use case is best addressed by a skill, workflow, connector, or knowledge-graph grounding.
• Translate platform strategy into technical designs, integrations, and implementation plans; evaluate platform capabilities and turn pilots into production-ready capabilities.
• Ensure implementations are scalable, secure, and aligned with organizational standards.
• Build and maintain connectors, APIs, and RAG and semantic-search patterns while preserving source-system permissions.
• Develop and maintain discovery tools and question sets that enable teams to scope AI use cases independently.
• Enable functional groups to curate and maintain their own context through tooling, patterns, and guidance.
• Establish testing and evaluation practices for agent-output quality, reliability, and safety.
• Configure, administer, and maintain Slack, Google Workspace/Gemini, Glean, and other AI assistants.
• Apply access-management, monitoring, and change-control practices, and troubleshoot complex platform issues.
• Implement technical controls for access, data retention, and sensitive-data handling with security, privacy, and compliance teams.
• Identify connectors requiring elevated or write access during design and route them for security review.
• Maintain technical documentation, runbooks, vendor coordination, incident-response procedures, and service-continuity procedures.
• Drive continuous improvement in platform reliability, search quality, and cost efficiency.

Benefits

• Professional growth opportunities, including mentorship, TechTalks, and personalized growth roadmaps.
• Competitive USD-based compensation.
• Budgets for education, fitness, and team activities.
• Flextime and options to work from home or go to the office.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed