Test Architect – Regression & Quality Strategy

Oowlish Technology

12d•Remote

About The Position

Oowlish is seeking an experienced Test Architect to lead the regression testing strategy and quality framework for a complex observability and audit platform used in multiple enterprise environments. This is a technical leadership role focused on defining successful validation across functional, performance, security, scalability, and infrastructure requirements. The role involves designing automation architecture, establishing test coverage and acceptance criteria, and acting as the quality gatekeeper throughout the development lifecycle. You will collaborate with engineering teams on logging, tracing, alerting, audit trail, and Infrastructure as Code (IaC) capabilities, ensuring the platform meets success metrics with new builds. The ideal candidate has extensive experience in designing regression and automation strategies for distributed, data-intensive, and infrastructure-heavy systems, and is comfortable with quality sign-off for business-critical technical platforms.

Requirements

8+ years of professional experience in Test Architecture, Quality Engineering, QA Automation, or similar technical quality roles.
Proven experience leading testing strategy for distributed, data-intensive, or infrastructure-heavy systems.
Deep experience designing comprehensive regression testing frameworks and automation strategies.
Experience validating more than functional behavior, including performance, scalability, security, and reliability.
Strong understanding of modern observability concepts and distributed systems.
Experience working with cloud-based infrastructure and automated deployment environments.
Strong understanding of software development lifecycles, Agile delivery, and sprint-based development.
Experience defining formal acceptance criteria and quality gates.
Strong written and verbal English communication skills.
Must Have: 8+ years of experience in Test Architecture, QA Engineering, Quality Engineering, or QA leadership roles.
Proven ownership of regression testing strategy and automation architecture.
Deep experience designing regression frameworks covering functional, performance, and security validation.
Experience testing distributed, data-intensive, infrastructure-heavy, or observability-related systems.
Working knowledge of OpenTelemetry and modern observability concepts.
Understanding of log and metrics pipelines.
Experience validating distributed tracing and/or observability workflows.
Working knowledge of AWS-based infrastructure sufficient to design meaningful technical test cases.
Experience validating Infrastructure as Code (IaC) deployments.
Experience working with Terraform-deployed environments.
Experience with load, scale, and performance testing.
Experience defining test strategies across multiple environments and/or product versions.
Experience defining test environments and test data strategies.
Experience translating technical success metrics into measurable and automatable acceptance criteria.
Experience working with formal quality gates and Definition of Done (DoD).
Comfortable owning quality sign-off and providing acceptance recommendations.

Nice To Haves

Previous experience testing observability platforms.
Experience with logging, monitoring, tracing, or telemetry platforms.
Experience validating audit trail integrity and immutability.
Experience with failure-injection or resilience testing.
Experience with compliance-oriented or security-sensitive platforms.
Experience testing ERP or other complex enterprise platforms.
Experience working across multiple versions of the same enterprise application.
Experience defining testing strategies for high-volume data ingestion systems.
Experience with performance benchmarking and scalability validation.
Experience working in client-facing technical engagements.

Responsibilities

Own and design the end-to-end regression testing strategy and framework across multiple platform components and enterprise environments.
Translate formal success metrics and technical evaluation criteria into clear, measurable, and automatable acceptance criteria.
Define comprehensive test coverage for: Log and metric ingestion. Search and query performance. Distributed tracing correctness. Audit trail integrity and immutability. Alert firing, delivery, and routing. Infrastructure as Code (IaC) deployment validation. Load and scalability scenarios. Failure-injection scenarios. Security and compliance-related acceptance criteria.
Design the automation architecture and determine the appropriate testing approaches and tooling.
Establish regression suites that continuously validate sprint deliverables.
Own test environment strategy and test data management across multiple product versions and environments.
Define approaches for performance, functional, security, and scalability validation.
Validate that Infrastructure as Code deployments are reproducible and meet defined acceptance criteria.
Collaborate with engineering teams to ensure testing approaches align with the underlying platform architecture.
Track testing progress, risks, defects, and overall quality status throughout the development lifecycle.
Provide clear quality reporting and recommendations during sprint reviews and stakeholder discussions.
Own quality gates and provide sign-off recommendations ahead of formal acceptance.