Senior Software Engineer, Automation & Testing

ProRata.ai•Bellevue, WA

25d•Onsite

About The Position

We are seeking an experienced Senior Software Engineer to lead and elevate our testing strategy for the backend subsystems that power our generative AI experiences. The ideal candidate will bring deep expertise in integration testing, test automation, and quality assurance, along with hands-on experience with tools like Railway, GitHub, TestRail, and Playwright (or similar platforms). In this role, you'll own the end-to-end test strategy and execution across multiple APIs and platforms, working closely with engineering teams to identify and resolve defects. You'll build robust verification systems within our CI/CD pipelines to ensure seamless, high-quality releases in staging environments. As the voice of the consumer, you'll champion exceptional quality standards and ensure our products deliver flawless experiences.

Requirements

Bachelor's or Master's degree in Computer Science, Engineering, or equivalent practical experience
5+ years of experience in software testing/QA engineering, with a strong focus on integration testing across distributed systems
Proficiency in Python and API automation
Hands-on experience with testing tools and platforms such as TestRail, Playwright, or equivalent frameworks
Demonstrated expertise with test automation frameworks, CI/CD pipelines (e.g., GitHub Actions, Jenkins), and version control systems (Git)
Strong understanding of cloud services and architectures, including containerization (Docker, Kubernetes), serverless functions (Lambda), and pipeline orchestration frameworks. Ability to evaluate trade-offs related to cost, latency, and design complexity.
Excellent analytical and problem-solving skills with proven ability to troubleshoot complex issues in distributed, multi-service environments
Passionate about quality, with a commitment to excellence

Nice To Haves

Direct experience with high volume advertising services and participation in their adoption growth

Responsibilities

Design and implement comprehensive test strategies for integration testing across backend subsystems and cloud services. Establish best practices and set the standard for cohesive, scalable testing methodologies.
Build and maintain automated test frameworks and tools to increase testing efficiency, coverage, and reliability across the development lifecycle.
Develop robust verification systems within CI/CD pipelines to enable confident, glitch-free deployments to production.
Regularly evaluate and enhance processes, tools, and methodologies to keep pace with evolving technologies and project requirements.
Identify, document, and track defects with precision. Lead early diagnosis, issue routing to subsystem owners, and triage sessions to ensure proper prioritization. Partner with cross-functional teams to balance issue impact against competing priorities.
Serve as the advocate for end-user quality, maintaining a high bar for product excellence.