AI Automation Engineer
About The Position
Greenboard is seeking its first dedicated Automation Engineer to own the testing framework, automated suites, and release process from scratch. This role is critical because Greenboard serves regulated financial institutions, where software quality directly impacts regulatory compliance. The engineer will be responsible for building and embedding testing practices with the engineering team, and will also tackle the unique challenge of testing AI systems with non-deterministic outputs. This is an opportunity to define testing standards in a fast-paced, high-ownership environment.
Requirements
- 3+ years testing software in high-consequence environments like fintech, healthtech, or payments.
- Ability to test systems beyond the UI, with proficiency in REST APIs and direct database querying.
- Experience writing resilient Playwright or Cypress suites, with strong opinions on selectors, fixtures, and test types.
- Skill in identifying edge cases and potential failure states in feature specifications.
- Experience holding release authority, including justifying release decisions.
- Ability to move fast and build things.
- Desire for deep ownership over product quality.
- Customer focus.
- Excellent communication skills.
- Value for collaboration.
- Located in NYC.
Nice To Haves
- Experience testing systems with non-deterministic output and defining quality thresholds.
- Experience with Node.js and React codebases on AWS.
- Experience debugging queue-based ingestion pipelines.
- Familiarity with SOC 2 audits and the evidence test suites can provide.
- Experience observing compliance officers, advisors, or back-office teams at work.
- Interest in the financial industry.
Responsibilities
- Build the test framework, automated regression suites, and QA practices from the ground up.
- Own testing for critical paths including message archiving and supervision, marketing review routing, employee attestations, and audit trails.
- Develop strategies for testing AI-driven detection and review, including the use of golden datasets and quality bars for non-deterministic output.
- Ensure data integrity at scale through end-to-end validation of message ingestion and user-facing data.
- Manage the release gate, including bug triage, release sign-off, and defining deployment-ready criteria.
Benefits
- 401(k) with 5% company match
- Medical, dental, and vision coverage
- 15 days PTO
- 11 company holidays
- Flexible sick time
- 2 additional PTO days for each year of service (up to 10 additional days)
- 10 remote days per year
- Additional remote days around the holidays
- Bi-annual off-sites and team retreats
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
