About The Position

Pencil is hiring a hands-on technical lead to grow the platform that runs AI agents across its products. The platform executes long, multi-step creative tasks for many customers at once, coordinating agents, tools, and model providers while delivering results reliably and at scale. The Lead Engineer will shape the platform’s scaling, failure handling, and performance, and lead a small engineering team responsible for building and operating it. The role covers agent orchestration and safeguards, distributed execution and customer isolation, data and state consistency, real-time progress streaming, usage metering, and observability. It also sets technical direction through design documents, architecture decisions, code reviews, and reliability and testing standards. The lead will manage and grow the team, run planning, reviews, and on-call, and help hire as the team expands. The role also sets the team’s practices for AI-assisted software development, including how to use coding agents such as Claude Code, Codex, and Cursor effectively and safely. Success is measured through fewer failed or timed-out tasks, faster results, accurate cost accounting, safe increases in concurrent work, and predictable delivery using AI tooling.

Requirements

  • 7+ years of experience building backend systems in production, with Python as a main language.
  • Experience running distributed workers or job systems on Kubernetes or similar, including queues, autoscaling, and safe deployments.
  • Strong relational database and caching skills, including concurrency and performance under load.
  • Production experience with LLM APIs, including tool use, streaming, token budgets, and handling provider errors and rate limits.
  • Daily experience using AI coding agents, including breaking work down for agents, supplying context, validating output against tests and real behavior, and assessing time savings and risks.
  • Track record of leading small engineering teams through delivery, including setting direction, mentoring, running reviews, and line-managing.
  • Evidence-led debugging skills using traces, logs, and metrics, with the ability to explain root causes before proposing fixes.

Nice To Haves

  • Go programming experience.
  • Experience with agent frameworks.

Responsibilities

  • Design and build the agent-execution platform for long-running, multi-step AI tasks, including orchestration, tool calling, model-provider integration, and safeguards.
  • Scale and operate distributed workers on cloud infrastructure, with customer isolation and graceful handling of failures and deployments.
  • Design data and state systems for work, conversations, and files, maintaining consistency under concurrent use.
  • Stream task progress to users in real time.
  • Implement accurate usage metering and tracing and metrics to understand time and cost.
  • Set technical direction through design documents, architecture decisions, and code review; establish reliability and testing standards.
  • Line-manage and grow a small engineering team; run planning, reviews, and on-call, and help hire as the team grows.
  • Set team practices for AI coding agents, including context, instructions, test harnesses, and where human review is required.
  • Debug using traces, logs, and metrics, and establish root causes before proposing fixes.

Benefits

  • 25 days PTO plus public holidays, under a Flexible Time Off scheme.
  • Health insurance / private medical cover.
  • Monthly stipend towards wellness, fitness, and learning and development.
  • Remote work from anywhere in your home country.
  • Enhanced parental leave policies for parents through birth, adoption, or surrogacy.
  • Access to Pencil’s office in The Shard, London for UK employees.
  • Flexible working hours.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service