QA Software Engineer NC Hybrid

Cisco•Rtp, NC
•Hybrid

About The Position

Cisco’s team is part of its AI and Automation portfolio and is responsible for the Circuit platform, the central AI engine supporting productivity and process automation across Cisco. The team works at the intersection of applied research and production, developing technology for performance, reliability, and functional quality for more than 80,000 monthly users. The Automation QA Engineer owns and advances the automated testing ecosystem that keeps Circuit reliable, scalable, and production-ready. The role transforms regression testing from manual processes to AI-driven, fully automated test suites for new and legacy features. It involves designing and maintaining end-to-end, API, and performance test automation; integrating tests into CI/CD pipelines; and using AI-assisted coding tools to create and maintain tests while verifying their stability, correctness, and security compliance. The position also develops approaches to evaluating AI/LLM features and agent workflows, communicates quality metrics and risks, and helps establish automation standards across teams. This is a hybrid position.

Requirements

  • Bachelor’s degree with 7+ years, master’s degree with 4+ years, or PhD with 1+ year of related experience in Computer Science, AI/ML, or a related technical field.
  • Experience in test automation and regression framework development, with a deep understanding of functional quality assurance.
  • Experience with Playwright (TypeScript/JavaScript) for E2E/UI automation and/or Python with Pytest or Robot Framework; familiarity with Selenium.
  • Experience with REST API testing and familiarity with API contract testing.
  • Conceptual and practical knowledge of software development lifecycles, including CI/CD pipelines such as GitHub Actions or Jenkins, and automated testing best practices.
  • Experience with AI-assisted coding tools such as GitHub Copilot, Cursor, or Claude Code, along with critical thinking and Agile/Git workflows to ensure high-quality, scalable test automation.

Nice To Haves

  • Experience testing AI/ML-powered web applications, including LLM-based features, chatbots, or AI agent workflows.
  • Hands-on experience with performance/load testing tools such as k6 or JMeter and AI/LLM performance metrics such as TTFT, inter-token latency, and token throughput.
  • Experience in AI Ops/MLOps or building or fine-tuning custom LLMs.
  • Experience with observability and reporting tools such as Splunk, Grafana, or Prometheus.
  • Familiarity with Docker and Kubernetes for test environment management and with Google Cloud Platform (GCP).
  • Track record of leading technical projects and mentoring junior engineers.
  • Strong communication and collaboration skills, including the ability to influence cross-functional stakeholders.
  • Experience building and productizing agentic applications with a focus on evaluation and business acceptance.
  • GraphQL testing experience.

Responsibilities

  • Architect, build, and maintain automated regression and end-to-end test suites for the Circuit platform using Playwright, TypeScript/JavaScript, Python/Pytest, and Selenium, replacing manual QA with scalable automation.
  • Design and automate REST and GraphQL API test suites covering functional correctness, contract validation, error handling, and performance, including AI/model-serving endpoints under concurrent load.
  • Plan and execute load, stress, and soak tests using k6 or JMeter; track response-time percentiles, throughput, error rates, Time to First Token (TTFT), and inter-token latency.
  • Use AI agents and AI-assisted coding tools to generate and maintain regression suites for new and legacy features; assess generated code for stability and security compliance before merge.
  • Develop testing approaches for AI/LLM features, including model response quality, behavioral consistency, and end-to-end AI agent workflows across reasoning and action layers.
  • Integrate automated tests into CI/CD pipelines and build dashboards and reports using tools such as Grafana and Allure.
  • Communicate quality metrics, risk assessments, and defect trends to engineering leadership.
  • Lead automation initiatives by defining standards, mentoring peers, and collaborating with development, product, and UX teams to embed automation-first testing into the development lifecycle.

Benefits

  • Medical, dental, and vision insurance, subject to plan eligibility rules.
  • 401(k) plan with Cisco matching contribution.
  • Paid parental leave.
  • Short- and long-term disability coverage.
  • Basic life insurance.
  • Paid holidays and a floating holiday for non-exempt employees.
  • Paid day off for an employee’s birthday.
  • Paid year-end holiday shutdown.
  • Paid personal wellness days.
  • Paid vacation time for non-exempt employees; exempt employees participate in a flexible vacation time off program.
  • Sick time off, with eligible unused time carried forward subject to the stated limit.
  • Additional paid time away may be requested for critical or emergency family issues.
  • Optional paid volunteer days.
  • Annual bonuses for eligible non-sales roles, subject to Cisco policies.
  • Potential grants of Cisco restricted stock units, subject to eligibility and vesting terms.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service