Automation Engineer

Blitzy•Cambridge, MA

4d•Onsite

About The Position

Automation Engineer About Blitzy Blitzy is a Cambridge, MA based AI software development platform on a mission to revolutionize the software development life cycle by autonomously building custom software to unlock the next industrial revolution. We're transforming how enterprises build software, turning enterprise requirements into production-ready code with an agentic software development platform that can autonomously execute 80% of the quantum of software development work. We're backed by multiple tier 1 investors, and have proven success as founders of previous start-ups. Location: Cambridge, MA (In-Person Role) Compensation: $90,000 - $145,000 + Equity The Role We are looking for an Automation Engineer to own, extend, and scale our automated testing frameworks that validate the runtime behavior of code generated by our AI platform. This role is critical in ensuring that our platform’s output performs correctly in production environments. You’ll work at the intersection of AI and quality assurance, expanding test coverage and improving the testing solutions that validate AI-generated applications during actual execution.

Requirements

3+ years of experience with Playwright and automated testing frameworks.
Strong expertise in Python (our primary automation language).
Experience with CI/CD tools (GitHub Actions or similar).
Proficiency in version control systems (Git).
Experience testing distributed systems.
Understanding of modern software development practices.
Experience working with cloud platforms (GCP preferred).

Nice To Haves

Experience with runtime monitoring and testing of distributed systems.
Knowledge of performance testing and APM (Application Performance Monitoring).
Experience with end-to-end testing of complex, enterprise-grade applications.
Understanding of distributed tracing and monitoring.
Experience with chaos engineering and resilience testing.

Responsibilities

Expand and maintain automated testing frameworks that validate the runtime behavior and performance of AI-generated applications.
Develop intelligent test suites that automatically assess application functionality in production environments.
Extend existing testing frameworks to increase coverage and validate runtime behavior across multiple languages and frameworks.
Establish quality metrics and testing protocols that measure real-world performance of generated applications.
Build systems to automatically detect and flag runtime issues in deployed applications.
Collaborate with our AI team to improve the platform based on runtime performance data.
Implement automated integration and end-to-end testing that ensures generated applications work as intended in production.
Develop metrics and monitoring systems to track runtime performance across different customer deployments.
Own the evolution and expansion of our automated testing frameworks for AI-generated code, increasing coverage and reliability.
Drive and expand end-to-end and integration testing coverage across production environments.
Drive runtime monitoring and quality assurance standards across multi-language deployments.
Manage CI/CD pipeline integration for continuous quality validation.
Collaborate cross-functionally with AI engineers to surface and resolve platform-level quality issues.