Software Architect

Harbor Compliance

About The Position

The Software Architect defines, modernizes, and owns the technical architecture that powers the platform at scale. Serving as the ultimate technical authority, this role balances the systematic deconstruction of legacy systems with the design of a highly scalable, secure, and future-ready platform. The Software Architect partners with executive leadership to translate business strategy into high-impact technical blueprints, institutionalizing AI-driven workflows and architectural guardrails that empower engineering teams to ship code rapidly, safely, and predictably.

Requirements

10 or more years of software engineering experience, including 4 or more years in a dedicated architecture or principal/staff engineer role.
Proven track record leading large-scale legacy modernization, including defining target-state architecture, sequencing domain decoupling, and executing migrations with zero unplanned downtime.
Demonstrated experience architecting production-level AI/ML systems, including LLM orchestration, agentic workflows, or intelligent automation at scale.
Deep expertise in modern distributed systems architecture, microservices, event-driven design, API gateway patterns, and cloud-native infrastructure.
Hands-on experience designing and governing AI/ML platform infrastructure, including LLM routing, prompt engineering patterns, vector databases, model evaluation frameworks, and cost optimization strategies.
Strong command of cloud infrastructure, CI/CD pipeline architecture, automated testing frameworks, and enterprise SaaS security and compliance requirements.
Experience partnering with VP and C-suite stakeholders to translate business strategy into technical roadmaps and smart investment decisions.

Nice To Haves

Familiarity with embedding AI-assisted development tooling into engineering standards and organization-wide development workflows.
Experience navigating architectural transformations, rapid scaling, or platform consolidation within high-growth or private equity-backed environments.
Knowledge of compliance, legal, or regulated industry SaaS products where data accuracy, auditability, and security are core platform requirements.

Responsibilities

Define and maintain the technical architecture, establishing pragmatic patterns and guardrails that accelerate rapid, high-quality feature delivery.
Lead the technical execution for migrating, decoupling, and modernizing legacy systems, owning the sequencing, risk mitigation strategies, and target-state designs to extract core business domains seamlessly.
Establish the core shared framework for integrating agentic workflows, intelligent automation, and LLM orchestration across the platform with strict compliance auditability and AI API latency under 100 ms.
Act as the definitive technical authority to proactively resolve cross-team architectural dependencies and ensure alignment across infrastructure and codebases.
Collaborate with Product leadership and the VP of Engineering to translate business milestones into an actionable technical roadmap, grounding technical debt reduction directly in business outcomes.
Author and embed standardized design templates into the software development lifecycle that leverage AI-assisted tools, driving 100% adoption across engineering pods and reducing cycle times by 35% or more.
Work closely with development, QA, and security teams to ensure architectural blueprints are highly practical, realistic, and friction-free for execution.
Design and implement LLM routing, caching, and model-governance architectures that optimize AI infrastructure costs to remain within 10% of the quarterly budget.