QA Automation Engineer

Milliman•Dallas, TX

18h•Remote

About The Position

Milliman, Global Corporate Services (GCS) is looking to hire a QA Automation Engineer. The ideal candidate will have hands-on expertise in developing and maintaining robust Java based test automation frameworks for M365 and cloud solutions. This person will be responsible for ensuring the delivery of high-quality, scalable, and secure software by leveraging industry leading automation and testing best practices. Experience in API, UI, and integration testing, especially within M365 and Microsoft’s cloud, is essential.

Requirements

Bachelor’s or master’s degree in computer science, Information Technology or related field.
Minimum 5 years of hands-on experience in QA and test automation for cloud-based applications, or equivalent industry experience as a Software Engineer working with cloud technologies.
Hands-on experience with automation testing tools, frameworks, IDEs and libraries such as Selenium, TestNG, WebDriver Manager, Apache POI, Extent Reports, Lombok, Rest Assured, Jackson Annotations, Feign Client, Microsoft Graph, Azure Identity, IntelliJ, and Jsoup.
Previous experience developing, maintaining, and executing automated tests for SharePoint, React applications and Azure cloud solutions.
Exposure to performance testing tools and security testing practices.
Scripting/coding skills, with a strong knowledge of API’s validation.
Experience with GitHub and Azure DevOps tools for version control and CI/CD pipelines.
Excellent problem-solving and analytical skills, with meticulous attention to detail.
Strong communication and interpersonal skills.
Ability to work collaboratively in a fast-paced environment.

Nice To Haves

Familiarity with AI-driven testing tools, Azure AI services, or test data generation utilities.
Microsoft certifications related to QA/Test Automation.
Experience in testing AI powered applications.
Experience with Agile/Scrum methodologies.
Proven track record of implementing continuous testing and quality improvements for SharePoint online and the M365 product suite.
Familiarity with monitoring and logging tools.

Responsibilities

Develop and maintain reusable test automation frameworks for web, API, and cloud-native solutions by using Java, Selenium, and TestNG.
Develop and automate test cases for Microsoft 365, SharePoint Online, Power Platform, and Azure-based applications, covering both frontend components (such as React, SPFx) and backend components (such as APIs, Azure Functions, Runbooks).
Implement and execute automated regression, smoke, integration, and performance tests to ensure high-quality releases.
Perform black box and other relevant testing methods to cover both positive and negative flows when automation is insufficient or infeasible.
Actively participate in design discussions and requirements review to provide input from a testing perspective.
Perform root cause analysis on defects, work closely with developers and support teams to prepare RCA reports in a timely manner.
Leverage AI-based tools, technologies and frameworks throughout the automation test cases development and finding defects in advance.
Collaborate closely with team members within an Agile framework, actively participating in sprint planning, assist in defining acceptance criteria, identifying any testing dependencies, and effectively sizing user stories to ensure clear requirements, and alignment with sprint goals.
Utilize Azure DevOps and GitHub to plan, track, and document work, ensuring transparency and effective project coordination.
Integrate automated testing with GitHub Actions to support both continuous and scheduled test cases execution.

Benefits

Medical, Dental and Vision – Coverage for employees, dependents, and domestic partners
Employee Assistance Program (EAP) – Confidential support for personal and work-related challenges
401(k) Plan – Includes a company matching program and profit-sharing contributions.
Discretionary Bonus Program – Recognizing employee contributions
Flexible Spending Accounts (FSA) – Pre-tax savings for dependent care, transportation, and eligible medical expenses
Paid Time Off (PTO) – Begins accruing on the first day of work. Full-time employees accrue 15 days per year, and employees working less than full-time accrue PTO on a prorated basis
Holidays – A minimum of 10 paid holidays per year
Family Building Benefits – Includes adoption and fertility assistance
Paid Parental Leave – Up to 12 weeks of paid leave for employees who meet eligibility criteria
Life Insurance & AD&D – 100% of premiums covered by Milliman
Short-Term and Long-Term Disability – Fully paid by Milliman