Senior QA Engineer
About The Position
As a Quality Engineer in Cisco’s Splunk Enterprise Security Apps organization, you will help build robust test infrastructure for an AI-powered Security Operations Center (SOC). The role focuses on the reliability, performance, and security of complex systems across the unified Splunk and Cisco organization. You will turn quality challenges into technical solutions, advance engineering efficiency through evaluation strategies, and contribute to the reliability, security, and integrity of Cisco’s security ecosystems. You will work with team members to implement benchmarking protocols, develop scalable testing infrastructure, and support technical performance goals. The work includes building evaluation frameworks for AI agents and workflows, developing AI-based solutions to mitigate risk, implementing proof-of-concepts, and applying advanced validation techniques such as LLM-as-judge methods, tenant isolation probes, and behavioral regression suites.
Requirements
- Bachelor’s degree.
- 8+ years of experience in software development and test automation, including building large-scale testing ecosystems.
- Programming experience with Python and Groovy, including designing scalable, maintainable, high-performance testing infrastructure.
- Experience working with security compliance frameworks.
- Experience implementing modern performance testing methodologies.
- Experience using AI to build automation, including writing AI skills to build test automation.
Nice To Haves
- Experience translating quality challenges into structured, actionable technical implementations.
- Experience applying modern tooling within the AI/ML landscape to improve detection efficacy and system reliability.
- Experience with test automation tools and frameworks, including contract testing frameworks and Playwright.
- Experience with security and compliance tools such as OCSF validation libraries, vacuum linter, Caldera, tenant isolation probes, and audit log validation.
- Experience in AI/ML testing using LLM APIs such as Claude and Codex, prompt engineering, agentic workflows, LangChain, and LangSmith.
Responsibilities
- Contribute to foundations and evaluation frameworks that assess AI agents, workflows, and system processes.
- Develop AI-based solutions or agents to mitigate risk and enhance system integrity across testing methodologies.
- Participate in code and design reviews, collaborate technically, and assist in validating technical hypotheses.
- Implement the lifecycle of proof-of-concepts while following standards for experimentation and validation of testing paradigms.
- Execute advanced validation techniques, including LLM-as-judge methodologies, tenant isolation probes, and behavioral regression suites.
- Collaborate with team members to implement benchmarking protocols and design scalable testing infrastructure.
- Translate quality challenges into technical solutions and drive engineering efficiency through evaluation strategies and implementation.
Benefits
- Medical insurance
- Dental insurance
- Vision insurance
- 401(k) plan with Cisco matching contribution
- Paid parental leave
- Short-term disability coverage
- Long-term disability coverage
- Basic life insurance
- 10 paid holidays per full calendar year
- Floating holiday for non-exempt employees
- Paid birthday day off
- Paid year-end holiday shutdown
- Personal wellness days
- Paid vacation or flexible vacation time off, depending on employee classification
- 80 hours of sick time off provided on hire date and each January 1st, with up to 80 unused hours carried forward
- Additional paid time away may be requested for critical or emergency issues for family members
- Optional 10 paid volunteer days per full calendar year
- Annual bonuses for eligible non-sales employees
- Potential Cisco restricted stock unit grants, subject to eligibility and vesting conditions
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
