Director, Strategic Analytics

Arch Insurance Group Inc.•White Plains, NY

1d•Remote

About The Position

Arch Capital Services, LLC., seeks Director, Strategic Analytics in White Plains, NY. This role is responsible for leading the design and execution of automated diagnostic test plans within an MLOps framework to ensure services meet high quality standards and business requirements. The position involves problem-solving, exploring, and implementing new technologies and processes to enhance the QA framework. The Director will lead and execute a strategic roadmap for the MLOps testing framework, identify process improvements to boost product quality and team performance, and lead a communication plan to update stakeholders on testing status and reports. They will also champion best practices for product requirements, technical execution plans, and testing objectives. The role includes leading and delegating project test plans and the QA lifecycle, evaluating and overseeing the creation and modification of test cases, test data, and automated test scripts, and analyzing new feature performance against established baselines. Additionally, the Director will lead documentation efforts for defects and resolutions and collaborate with QA engineers, project leads, and leadership. Responsibilities include quality assurance with APIs and testing APIs using automation resources like Azure Portal, Function Apps, and Databricks, directing the creation of automation scripts, and using SQL and Python for data querying. The role requires experience with Windows, Web Applications, and/or Web Service environments for the quality assurance framework, and working with JIRA or similar Agile resources, as well as multiple testing resources such as HP ALM, HP LoadRunner, Selenium, ReadyAPI, and/or SOAP UI.

Requirements

Master’s degree or foreign equivalent in Computer Science or related field plus 5 years of experience in the job offered or related software testing position.
Experience leading and/or supervising a cross functional team.
Experience with MLOps framework.
Experience with API automation testing.
Experience with Azure, Azure Function Apps, and Azure Databricks.
Experience shaping the development of automation scripts.
Experience with SQL and Python.
Experience with Windows, Web Applications and/or Web Service environments.
Experience with multiple testing resources including HP ALM, HP LoadRunner, Selenium, Ready API and SOAP UI.
Experience with Databases SQL, Azure SQL.
Experience with testing frameworks including HP Unified Functional Testing (UFT), Cypress, and REST Assured.
OR Bachelor’s degree or foreign equivalent in Computer Science or related field plus 7 years of experience in the job offered or related software testing position.
Experience leading and/or supervising a cross functional team.
Experience with MLOps framework.
Experience with API automation testing.
Experience with Azure, Azure Function Apps, and Azure Databricks.
Experience shaping the development of automation scripts.
Experience with SQL and Python.
Experience with Windows, Web Applications and/or Web Service environments.
Experience with multiple testing resources including HP ALM, HP LoadRunner, Selenium, Ready API and SOAP UI.
Experience with Databases SQL, Azure SQL.
Experience with testing frameworks including HP Unified Functional Testing (UFT), Cypress, and REST Assured.

Responsibilities

Lead the design and execution of automated diagnostic test plans in MLOps framework.
Problem-solve, explore, and implement new technology and processes to improve the QA framework.
Lead and execute a strategic roadmap for the MLOps testing framework.
Identify and implement process improvements to increase product quality and team performance.
Lead and execute a communication plan to keep stakeholders updated with testing status and reports.
Lead best practices of product requirements, technical execution plan, and testing objectives.
Lead and delegate project test plans and the QA lifecycle across the team.
Evaluate and oversee creation and modification of test cases, test data, and automated test scripts.
Analyze new feature performance against established baselines.
Lead documentation efforts of defects and resolution.
Collaborate with QA engineers, project leads, and leadership.
Perform quality assurance with APIs and testing APIs using test automation resources such as Azure Portal, Function Apps, and Databricks.
Direct the creation of automation scripts.
Use SQL and Python for querying data.
Utilize Windows, Web Applications and/or Web Service environments for quality assurance framework.
Work with JIRA or similar Agile resources as well as multiple testing resources including HP ALM, HP LoadRunner, Selenium, ReadyAPI and/or SOAP UI.