Director, Enterprise Quality Engineering and Agentic Evaluation

Zayo Group

1d•$126,600 - $194,700•Remote

About The Position

Zayo is seeking an experienced Director to build and lead a modern enterprise quality capability across its technology organization. The role is accountable for improving the reliability, predictability, and speed of technology delivery while providing independent assurance for critical business platforms, transformational programs, and AI-enabled solutions. The Director will bring deep quality engineering expertise and enterprise leadership to establish a risk-based, automation-first approach across the software delivery lifecycle. The role will also shape how Zayo evaluates and governs agentic AI capabilities so they are reliable, controlled, and suitable for enterprise-scale adoption. This collaborative, transformational leadership position partners with Engineering, Product, Architecture, Data and AI, Operations, and business teams to strengthen quality outcomes, reduce production risk, and foster measurable engineering excellence. The Director owns Zayo’s enterprise quality engineering strategy and platform, leads centralized quality engineering services, provides independent quality intelligence and release-risk assessments, and manages vendor and partner resources.

Requirements

Bachelor’s degree in Computer Science, Engineering, Information Systems, Mathematics, or a related discipline; equivalent relevant experience may be considered.
At least 12 years of experience in quality engineering, software testing, test automation, platform engineering, enterprise technology delivery, or related technology disciplines.
At least 5 years leading quality engineering, test automation, enterprise testing, or platform-oriented teams.
Demonstrated experience building or leading modern quality engineering capabilities beyond manual test execution, including automation strategy, risk-based testing, continuous testing, quality gates, and release assurance.
Strong experience with enterprise test automation and test management platforms.
Experience leading testing or quality engineering across multiple products, platforms, business processes, programs, or business units.
Strong understanding of API, integration, data, workflow, cloud, event-driven, distributed-system, performance, resilience, and production validation testing.
Practical knowledge of generative AI, large language models, retrieval, AI agents, tool calling, evaluation methods, and responsible AI testing practices.
Strong executive communication, stakeholder management, vendor management, financial management, organizational leadership, and decision-making skills.

Nice To Haves

Experience with Tricentis Tosca and qTest is preferred.

Responsibilities

Define and lead Zayo’s enterprise quality engineering strategy, operating model, roadmap, service catalog, standards, and governance.
Own the enterprise quality engineering platform, including Tosca, qTest, automation assets, integrations, test execution infrastructure, quality reporting, and AI-evaluation capabilities.
Establish risk-based quality models, release-readiness criteria, quality gates, certification standards, and evidence requirements for critical platforms, business processes, integrations, data products, and AI agents.
Lead a centralized quality engineering service that plans, automates, executes, and governs testing across enterprise products, platforms, programs, and high-risk releases.
Develop reusable automation frameworks, model-based testing patterns, API and integration testing capabilities, regression suites, and continuous testing practices aligned to business risk and production impact.
Establish enterprise capabilities for AI-agent evaluation, including scenario design, evaluation datasets, regression testing, tool-use validation, policy and permission checks, human escalation criteria, and production quality monitoring.
Own the enterprise approach to test data, test environments, service virtualization, production validation, and quality analytics to reduce release risk and delivery delays.
Provide independent quality intelligence and release-risk assessments to engineering, product, program, and executive stakeholders.
Manage vendor-outsourced quality engineering resources, Tricentis partners, systems integrators, and specialist testing providers to deliver sustained enterprise quality outcomes.
Build a quality engineering culture focused on automation, objective assurance, reuse, engineering discipline, measurable outcomes, and continuous improvement.