Engineer IV (QA)

College Board • VA

116d • $137,000 - $148,000

About The Position

As an Engineer IV focused on quality, you are responsible for ensuring the quality and reliability of key scoring capabilities of College Board’s assessments through advanced testing strategies, automation frameworks and an advanced knowledge of QA best practices. Leveraging your AWS expertise, strong analytical and problem-solving skills, you will analyze complex feature requirements, automate testing processes, and drive efficiencies. Collaborating with cross-functional teams, you will contribute to improving reliability and efficiency of systems. This role is ideal for someone who thrives in a fast-paced, Agile environment and is eager to make a meaningful impact on the digital transformation of SAT, PSAT, and AP exams.

Requirements

• Bachelor’s degree in computer science, Computer Engineering, Software Engineering or equivalent preferred
• 5+ years of professional experience in enterprise-wide software quality assurance
• Strong analytical and problem-solving skills with a keen eye for detail
• Excellent communication and collaboration skills to work across technical and business teams
• Understanding of Agile methodology with a willingness/ability to work in a DevOps environment
• Strong proficiency in test automation
• Experience with CI/CD tools
• Knowledge of scripting/programming languages/tools (e.g., JavaScript, Nodejs, cucumber, etc.)
• Minimum of 1-2 years of hands-on experience working with AWS services, including Lambda, S3, Step Functions, DynamoDB, SNS, SQS, CloudWatch and more
• Proactive with a strong sense of ownership and responsibility
• Capable of analyzing, planning, designing, and owning vaguely defined issues with little supervision
• Collaborative attitude that incorporates various perspectives
• Strong problem solving and organizational skills

Nice To Haves

• Experience with TypeScript
• Any experience applying AI-driven test automation or predictive analytics for defect detection
• Hands-on experience with CI/CD and NoSQL
• Skilled at creating/generating complex test data that aligns with business rules, covering edge cases and complex scenarios

Responsibilities

• Design, develop, implement and maintain comprehensive test plans, test cases and automated test suites
• Collaborate with product managers and developers to review requirements and ensure testability
• Design and develop automated testing frameworks for scoring products
• Maintain CI/CD pipelines with integrated automated testing
• Identify, recommend and implement tools to enhance testing efficiency
• Conduct functional, regression, performance and security testing
• Track and analyze test results, defect trends and root causes
• Ensure compliance with quality and security standards
• Collaborate with business and technical teams to translate data insights into actionable recommendations
• Develop and participate in the review of requirements, data mappings, user stories, and other artifacts
• Assist in resolving production issues by troubleshooting and working with engineering teams to implement fixes
• Support functional testing by validating data accuracy, system behavior, and process integrity

Benefits

• Annual bonuses and opportunities for merit-based raises and promotions
• A mission-driven workplace where your impact matters
• A team that invests in your development and success

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: Bachelor's degree
• Number of Employees: 1,001-5,000 employees