AI Solutions Architect (Agentic AI)

OZ Digital • Boca Raton, FL

1d • Hybrid

About The Position

We are seeking a strategic and hands-on AI Solutions Architect who can define and lead the architecture of enterprise-scale Agentic AI solutions. The ideal candidate combines deep technical expertise in generative AI, cloud platforms, enterprise architecture, and AI governance with the ability to influence business and technology leaders. You are passionate about turning emerging AI capabilities into secure, scalable, and high-value business outcomes while establishing the standards, guardrails, and architectural patterns that enable multiple teams to successfully deliver AI-powered solutions. As an AI Solutions Architect (Agentic AI), you will partner with Architecture and Engineering leadership to shape the organization's AI strategy, reference architectures, and technology roadmap. You will be responsible for designing enterprise AI platforms, agentic AI frameworks, RAG architectures, governance standards, security controls, and integration patterns that support scalable and responsible AI adoption. This role requires evaluating emerging technologies, guiding build-versus-buy decisions, establishing engineering best practices, and collaborating across business, security, data, and technology teams to deliver innovative AI solutions that drive measurable business value.

Requirements

• 8-10+ yrs. experience in software engineering and architecting enterprise solutions, including production systems you personally helped build
• Architectural depth in one major cloud provider (Azure, AWS, or GCP) with hands-on familiarity in at least one other
• Demonstrated experience architecting generative AI solutions on an enterprise platform - Azure OpenAI / AI Foundry, AWS Bedrock or Google Vertex AI
• Proven design of complex RAG pipelines, including their evaluation and observability
• Experience designing agentic or multi-agent systems: task decomposition, tool use, state and memory, guardrails and fallbacks
• Hands-on experience with at least one orchestration framework (LangGraph, LangChain, Semantic Kernel, LlamaIndex or equivalent) and enough Python to prototype and review code credibly
• Working knowledge of AI security and governance: prompt injection, data protection, responsible AI controls, and at least one formal framework (NIST AI RMF or ISO/IEC 42001)
• Experience in DevOps, SDLC, containers, Kubernetes, microservices, event-driven and API design
• Knowledge of architecture principles and industry-standard frameworks; data architecture and integration experience across a diverse landscape of package and custom applications
• Experience working with customer data-pertaining systems such as loyalty systems, CRM, and CDP; understanding of different datastore types and how data flows across systems
• Well-versed in API management to monitor security, application connections, traffic, and standardization
• Experienced in sizing AI workloads for optimal performance, latency, and cost, with a thorough understanding of the underlying infrastructure
• Performs work with a high degree of latitude. Handles the most complex issues. Possesses expert knowledge of subject matter. Provides leadership, coaching, and mentoring to the team
• Excellent communication skills - able to hold a design position with senior engineers and explain the same trade-off to a non-technical executive without losing the substance
• Bachelor's degree in math, computer science, or a related tech field and 8 or more years of experience

Nice To Haves

• Multi-cloud architectural experience across Azure, AWS, and GCP
• Data platform depth (Databricks, Snowflake) and Lakehouse architecture
• Model fine-tuning or instruction-tuning strategy; small-language-model and edge inference for cost efficiency
• Agent identity and authorization design at enterprise scale
• Delivery experience in a regulated environment, including model risk management exposure
• Preferred certification in TOGAF, or professional-level cloud architecture certification (Azure Solutions Architect Expert, AWS Solutions Architect Professional, GCP Professional Cloud Architect)
• Published work, patents, conference speaking, or open-source contribution in the AI space

Responsibilities

• Shape the AI strategy and roadmap: Align AI capabilities and investments with business priorities, while honestly assessing data, technology, and organizational readiness and sequencing initiatives for the greatest impact.
• Define the architecture for agentic AI: Establish enterprise reference architectures for different agent patterns, including supervisor/worker, peer-to-peer, sequential workflows, and provide clear guidance on when to use each approach.
• Architect the AI knowledge and memory layer: Design how AI solutions manage session context, long-term knowledge, vector stores, knowledge graphs, and audit or episodic memory so information can be retrieved consistently and reliably.
• Establish enterprise RAG patterns: Define standards for retrieval-augmented generation, caching, embeddings, vector search, reranking, data lineage, observability, and evaluation so teams can build solutions consistently and at scale.
• Set standards for AI tools and agent interfaces: Define patterns for APIs, MCP servers, agent tools, and inter-agent communication so capabilities can be securely reused across applications and delivery teams.
• Lead build-versus-buy decisions: Evaluate models, platforms, and vendors based on business value, capability, cost, scalability, flexibility, and long-term risk, including decisions around multi-model strategies, the use of both frontier and smaller language models.
• Help determine where AI belongs: Challenge whether a problem truly needs an agent, should use a deterministic workflow, or should not be automated. Make these decisions based on business value, risk, complexity, and measurable outcomes.
• Establish GenAIOps and engineering standards: Define enterprise practices for AI development, CI/CD, infrastructure, deployment, monitoring, and observability, including metrics such as latency, token consumption, decision traces, hallucination rates, and cost per outcome.
• Architect enterprise AI guardrails: Establish patterns for reducing hallucinations, protecting against prompt injection, safeguarding PII, preventing data loss, detecting bias, and controlling model outputs.
• Design secure agent identity and authorization: Define how agents authenticate and operate with least-privilege access, secure credentials, tenant isolation, row- and column-level permissions, and protection against privilege escalation across chained tool calls.
• Drive responsible AI governance: Apply frameworks such as NIST AI RMF, ISO/IEC 42001, and OWASP LLM Top 10 while partnering with Security, Legal, Data Governance, and Compliance teams on data classification, auditability, residency, and regulatory requirements.
• Architect enterprise integrations: Define scalable integration patterns between AI and enterprise platforms such as identity, collaboration, loyalty, CRM, CDP, ERP, and data Lakehouse.
• Partner across business, product, and technology teams: Work with business leaders, product teams, engineering, security, data, and infrastructure teams to develop solutions that balance reusability, maintainability, integration, cost, technical debt, scalability, and security.
• Advise senior and executive stakeholders: Translate complex AI opportunities and architectural trade-offs into clear recommendations, solution proposals, roadmaps, and architecture decisions that enable informed business decisions.

Benefits

• Competitive Pay
• 401K
• Health Coverage
• full health coverage
• a 401K
• unlimited PTO

What This Job Offers

• Job Type: Full-time
• Career Level: Senior