AI Quality Assurance Specialist Sr. Lead

Entergy • Woodlands, TX

1d • Hybrid

About The Position

The AI Quality Assurance Specialist Sr. Lead will be responsible for creating detailed test plans and executing testing activities for both traditional and ML-based solutions. This role involves designing and developing automation scripts, identifying and tracking bugs, and performing regression testing. The specialist will also develop and maintain testing frameworks for machine learning models, apply testing processes to meet client needs, monitor debugging results, and track quality assurance metrics. Collaboration with internal teams, participation in scrum ceremonies, and identifying quality control issues from an end-to-end perspective are key aspects of this position. The preferred location for this role is New Orleans, LA, but other locations within Entergy’s service territory may be considered.

Requirements

• Bachelor’s degree in computer science, MIS, business administration, or other technical area of study OR equivalent work experience.
• At least 8 years of professional experience.
• At least 4 years of experience testing ML/GenAI solutions.
• Strong knowledge of software QA methodologies, tools, and processes.
• Familiarity working with Agile development teams.
• Good communications skills; ability to effectively communicate verbally and in writing with both non-technical and technical staff.
• Proficient in both white box and black box testing methods.
• Ability to work both independently and as part of a team.
• Authorization to work in the United States is a precondition to employment in this position.
• Entergy will not sponsor candidates for work visas for this position.

Nice To Haves

• Advanced degree is a plus.
• Working knowledge of automated testing tools.
• Highly proficient SQL and scripting skills.
• Experience testing AI/ML systems in cloud-based environments.
• Experience integrating automated AI testing into CI/CD pipelines (e.g., GitHub Actions or similar tools).
• Experience with monitoring and logging systems for post-deployment model validation.
• Advanced experience testing generative AI systems, including LLMs for accuracy, bias, safety, and hallucinations.
• Familiarity with RAG evaluation workflows and vector databases (e.g., FAISS, Pinecone, Weaviate).
• Experience with prompt engineering, adversarial prompting, and synthetic data generation.
• Any ServiceNow, Scrum, or ITIL certifications are a plus.

Responsibilities

• Create detailed, comprehensive, and well-structured test plans and test cases for traditional and ML-based solutions.
• Estimate, prioritize, plan, and coordinate testing activities.
• Design, develop, and execute automation scripts.
• Identify, record, document, and track bugs.
• Perform thorough regression testing when bugs are resolved.
• Develop and maintain robust testing frameworks for machine learning models.
• Develop and apply testing processes for new and existing products to meet client needs.
• Monitor debugging process results.
• Investigate the causes of non-conforming software.
• Track quality assurance metrics, such as defect densities and open defect counts.
• Collaborate with internal teams (e.g. developers, product managers, and designers) to identify testing requirements.
• Identify and prioritize quality control issues from an end-to-end perspective.
• Participate in scrum ceremonies such as refinement, demo, and release planning.

Benefits

• Equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a protected veteran in accordance with applicable federal, state and local laws.
• Compliance with applicable state and local laws governing non-discrimination in employment.
• Policy applies to all terms and conditions of employment including, but not limited to, recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.
• Prohibition of unlawful employee harassment based on race, color, religion, sex, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
• Prohibition of improper interference with the ability of employees to perform their expected job duties.
• Provides reasonable accommodations for online applicants.
• Affirmative action program for individuals with disabilities and protected veterans shall be available for inspection upon request.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior