Sdet

CertifyOS

About The Position

CertifyOS is hiring an AI-first Software Development Engineer in Test (SDET) to help build reliable, scalable, high-quality software. The role goes beyond traditional QA and test automation, using AI-assisted engineering and agentic workflows to accelerate test development, improve coverage, automate quality checks, and identify performance and scalability issues. The SDET will work with developers, product managers, and engineering leaders to embed quality throughout the software development lifecycle. The role includes adopting AI-assisted and agentic approaches across testing; building and maintaining automation for UI, API, integration, and end-to-end testing; designing performance and load tests; validating scalability and reliability; and partnering with engineering and product teams on quality risks, reviews, quality gates, and automation standards. The position also contributes to AI-powered testing workflows and continuous improvement in engineering productivity.

Requirements

3–6 years of experience in software testing and automation engineering.
Strong programming skills in Python, Java, or JavaScript/TypeScript.
Hands-on experience with Playwright, Cypress, Selenium, or equivalent frameworks.
Strong API automation and backend testing experience.
Experience with performance testing tools such as k6, JMeter, or Locust.
Understanding of microservices and distributed systems.
Good knowledge of SQL and database testing.
Experience integrating automated tests into CI/CD pipelines.
Practical experience using AI coding assistants and AI agents.
Ability to analyze logs, metrics, and performance bottlenecks.
Comfort working with AI coding agents such as Claude Code, Cursor, or GitHub Copilot.
Ability to use AI to generate test scenarios, automation scripts, and test data.
Understanding of how to validate AI-generated code and prevent unreliable tests.
Willingness to explore agentic workflows for autonomous test execution and failure analysis.
Ability to build reusable AI-powered testing workflows rather than relying only on manual prompting.

Nice To Haves

Experience with AWS or GCP.
Familiarity with Docker and Kubernetes.
Experience with Kafka or other messaging systems.
Exposure to Grafana, Prometheus, Datadog, or similar observability tools.
Knowledge of chaos engineering and resilience testing.
Experience with database performance tuning.

Responsibilities

Adopt AI-assisted and agentic approaches across the testing lifecycle, including using AI coding agents to generate, execute, debug, and maintain automated tests.
Build AI-assisted workflows to generate test cases from product specifications and acceptance criteria.
Explore agentic testing workflows that execute tests, identify failures, and report defects; use AI to analyze failures, find patterns, and suggest root causes.
Identify opportunities to reduce manual effort through AI and automation.
Build and maintain scalable automation frameworks for UI, API, integration, and end-to-end testing.
Develop reusable test components and automation libraries; automate critical business workflows and regression suites.
Integrate automated testing into CI/CD pipelines.
Design and execute load, stress, spike, and endurance tests, simulating realistic traffic, concurrent users, and high-volume API requests.
Establish performance benchmarks and service-level objectives, and analyze latency, throughput, resource utilization, and error rates.
Identify bottlenecks across APIs, databases, microservices, and infrastructure, and work with developers to resolve them.
Validate application behavior as traffic, data volume, and workloads increase, and identify scalability limitations in distributed systems.
Test asynchronous workflows, queues, event processing, retries, and failure recovery.
Evaluate database performance and query efficiency under load; identify resource constraints and potential points of failure.
Contribute to capacity planning and reliability improvements.
Work with developers and product managers to identify quality risks early.
Participate in technical design and code reviews, define quality gates and automation standards, and promote shared responsibility for quality.

Benefits

100% coverage of health, dental, and vision insurance premiums for employees in the US.
Unlimited PTO for the US-based team, with at least two weeks off each year.
Health insurance for employees in India.
Statutory leave benefits for employees in India.
Additional wellness (menstrual) leave for women in India.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume