Product Platform Verification Engineer - Smartly

Datacom

6d • Remote

About The Position

The Smartly Platforms and Architecture Team is seeking a Product Platform Verification Engineer to lead the development and maintenance of frameworks, pipelines, and guardrails that ensure the engineering organization's confidence in its product releases. The role involves addressing the challenges of increasing code generation by agents, ensuring quality is maintained at the earliest stages of the delivery cycle, and making verification an appealing and accessible process for engineers. This position is crucial for maintaining quality in a rapidly evolving software development landscape where AI-generated code is becoming more prevalent. The engineer will be responsible for verifying not just output code but also the inputs that generate it, ensuring adherence to architectural designs, logging standards, observability, and overall engineering conventions. The role requires a proactive approach to building quality automation and pipelines to safeguard the company's operations, especially as development velocity increases.

Requirements

• Experience building verification infrastructure, not just executing manual scripts.
• Proven ability to design and maintain automated frameworks used by other engineers.
• Experience verifying web applications, APIs, and data layers across functional and non-functional requirements.
• Experience integrating verification into CI/CD pipelines.
• Ability to diagnose weak pipeline signals.
• Comfortable performing demanding engineering work in the context of verification.
• Proficiency in reading and writing at least one of C#/dotnet, Python, or TypeScript fluently, and ability to read across all three.
• Ability to write code that other engineers depend on.
• Strong judgment, taste, vision, and context.
• Ability to differentiate between actual coverage and the appearance of coverage in AI-generated tests.
• Holistic thinking about verification, including inputs, outputs, specs, code, architecture, and standards.
• Excitement about the impact of AI on engineering.
• Belief in the importance of writing for clarity and thinking.
• Ability to respect focus time and act with remote-first intentionality.

Nice To Haves

• Experience with agentic environments for verification.
• Experience with scaffolding generation, gap analysis, and agent-driven exploration of failure modes.
• Experience building complete environments for agents to validate their own work.

Responsibilities

• Build and maintain verification frameworks, pipelines, and guardrails for the engineering organization.
• Develop input verification strategies to assess intangible qualities of the product.
• Assess the quality and coverage of current automation harnesses.
• Fill identified gaps in verification coverage.
• Experiment with and implement new methods for assessing adherence to architectural principles.
• Write documentation for verification approaches, failure-mode analyses, and coverage gap analyses.
• Develop agentic prompts for team-wide use.
• Code on the frameworks and pipeline tooling owned by the role.
• Collaborate on shared AI tooling to enhance engineering productivity.
• Write down decisions, designs, tradeoffs, and post-incident learnings.
• Integrate verification into CI/CD pipelines.
• Debug weak pipeline signals.
• Make decisions about appropriate verification approaches for different problems.
• Build infrastructure that hooks into CI/CD pipelines, monoliths, and microservices.
• Help shape the future state of the verification stack.

Benefits

• Focus time is non-negotiable.
• Meetings have a purpose or they don't happen.
• Tendency to focus in the morning and meet in the afternoons.
• Async standups by default.
• 3 o'clock Smoko twice a week where work talk is banned and connection as humans is prioritized.
• Commitment to building a team that reflects Aotearoa New Zealand.
• Encouragement for women, Māori, Pasifika, takatāpui, disabled and neurodivergent engineers, and anyone who took a non-linear path into the work.
• Willingness to provide adjustments for candidates to be at their best.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed