QA Automation Engineer II - IntelliScript (Remote)

Milliman • Brookfield, WI

1d • $78,800 - $145,130 • Remote

About The Position

Milliman IntelliScript is a group of experts in actuarial science, information technology, and clinical practice who develop and deploy data-driven, software-as-a-service (SaaS) products for insurance clients. As a business unit within Milliman, Inc., IntelliScript offers an entrepreneurial and collaborative culture focused on innovation, excellence, customer service, balance, and transparency. Every employee has a voice, and the company encourages pushing potential and offers opportunities for growth in skills, responsibilities, and career. The team is described as smart, down-to-earth, and receptive to ideas, rewarding excellence with competitive compensation and benefits. Milliman invests in skills training, career development, and provides access to learning and mentoring opportunities. Employee Resource Groups (ERGs) influence policy, develop leaders, and amplify employee voices. Employees are encouraged to contribute to their professions and take on leadership roles in professional organizations. Milliman's commitments to people, diversity, inclusion, social impact, and sustainability are highlighted.

Requirements

• 2+ years of software quality assurance or software testing experience
• Strong hands-on experience manually testing web-based applications
• Experience testing APIs with Postman or a similar tool
• Ability to create effective test cases, test scenarios, and exploratory test charters from requirements and acceptance criteria
• Experience with functional, integration, regression, negative, and end-to-end testing techniques
• Experience documenting and managing defects in Jira or a similar tracking tool
• Working knowledge of SQL for test data setup, backend validation, or defect investigation
• Experience using generative AI tools to support software testing activities—such as test case development, exploratory testing, test data creation, defect investigation, or test automation—with appropriate review and validation of AI-generated outputs
• Experience working within an Agile or Scrum delivery team

Nice To Haves

• Experience with Zephyr, TestRail, or another test management platform
• Exposure to UI or API test automation through professional experience, training, or personal projects
• Familiarity with automation tools or frameworks such as Playwright, RestSharp, Reqnroll, Selenium, or comparable technologies
• Basic programming or scripting experience in C#, JavaScript, TypeScript, Java, Python, or a similar language
• Experience executing automated tests through a CI/CD pipeline and reviewing results
• Experience using generative AI tools to support test design, test data creation, defect analysis, or automation, with appropriate human review
• Experience testing software-as-a-service (SaaS) or other complex business applications

Responsibilities

• Design, document, maintain, and execute test cases for new features, enhancements, integrations, and regression coverage.
• Perform functional, exploratory, integration, smoke, regression, and end-to-end testing across web-based user interfaces and APIs.
• Validate user workflows, business rules, field behavior, navigation, error handling, usability, and cross-browser behavior.
• Test REST APIs using tools such as Postman, including requests, responses, status codes, payloads, authentication, validation rules, and negative scenarios.
• Use SQL and available logs or diagnostic information to validate data and investigate issues across application layers.
• Review requirements, user stories, acceptance criteria, and technical designs to identify gaps, edge cases, dependencies, and quality risks before development is complete.
• Create clear, reproducible defect reports that include expected and actual results, supporting evidence, business impact, and appropriate severity.
• Collaborate with developers to troubleshoot issues, verify fixes, and determine appropriate regression coverage.
• Maintain test cases, execution results, and traceability in Zephyr or a comparable test management tool.
• Participate actively in Agile ceremonies, including refinement, sprint planning, daily stand-ups, demonstrations, and retrospectives.
• Provide concise input on release readiness, unresolved risks, and recommended follow-up testing.
• Identify stable, repetitive test scenarios that are strong candidates for automation.
• Execute and review automated test suites where applicable, troubleshoot basic failures, and partner with automation-focused engineers to improve coverage.
• Contribute to UI or API automation over time based on experience, interest, and team priorities.

Benefits

• Medical, Dental and Vision - Coverage for employees, dependents, and domestic partners.
• Employee Assistance Program (EAP) - Confidential support for personal and work-related challenges.
• 401(k) Plan - Includes a company matching program and profit-sharing contributions.
• Discretionary Bonus Program - Recognizing employee contributions.
• Flexible Spending Accounts (FSA) - Pre-tax savings for dependent care, transportation, and eligible medical expenses.
• Paid Time Off (PTO) - Begins accruing on the first day of work. Full-time employees accrue 15 days per year, and employees working less than full-time accrue PTO on a prorated basis.
• Holidays - A minimum of 10 paid holidays per year.
• Family Building Benefits - Includes adoption and fertility assistance.
• Paid Parental Leave - Up to 11 weeks of paid leave for employees who meet eligibility criteria.
• Life Insurance & AD&D - 100% of premiums covered by Milliman.
• Short-Term and Long-Term Disability - Fully paid by Milliman.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed