Member of Technical Staff (All Levels) - Applied ML

Basis AI•New York, NY

1d•Onsite

About The Position

As an ML Engineer at Basis, you'll own end-to-end projects that bring intelligence into production. You'll be the Responsible Party (RP) for systems that help our agents reason, plan, and evaluate themselves. That means you'll scope, build, and deliver from first principles. You'll have full autonomy: plan your projects, define success, run experiments, and decide when your system is ready to ship. You'll move fast, instrument everything, and design for clarity. You'll build the scaffolding that lets models act safely and improve continuously. This is a role for engineers who want to be both researchers and builders: reasoning through problems, experimenting with solutions, and shipping systems that get smarter over time.

Responsibilities

Build and evolve our agent systems
Design and iterate multi-agent architectures that automate real accounting workflows.
Build in autonomy boundaries, tool usage, and fallback behaviors that make agents safe and reliable.
Manage context and memory for coherence across steps. Plan and execute agent loops with measurable success criteria.
Route, evaluate, and optimize models under real-world constraints (latency, cost, accuracy).
Design evaluation and experimentation frameworks
Build scalable evaluation pipelines (offline and online) that run hundreds of experiments automatically.
Define golden tasks, labeling strategies, and metrics that make performance measurable and comparable.
Instrument the stack to detect regressions, track error patterns, and drive continuous improvement.
Use data and experiments to drive product and architectural decisions, not just intuition.
Engineer for context and retrieval
Build prompt stacks and instruction hierarchies that structure model reasoning.
Create retrieval and indexing pipelines that surface relevant context efficiently.
Parse messy documents into structured representations that agents can understand.
Design guardrails and validation layers to keep behavior safe and predictable.
Operate as an RP: plan, build, deliver
Scope your projects clearly. Write concise specs and architecture docs that eliminate ambiguity.
Build, test, and instrument your systems end-to-end.
Communicate progress clearly: what's built, what's learned, what's next.
Work closely with your pod, teaching, unblocking, and sharing learnings as you go.