Software Engineer, AI Runtime & Platform Services

CrewAI • San Francisco, CA

2d

About The Position

CrewAI is seeking a Software Engineer to work on the enterprise runtime layer of their AI agent management platform. This role focuses on transforming CrewAI's open-source framework into secure, observable, and remotely executable production systems. The engineer will be responsible for the layer between the framework and the platform, handling APIs, workers, checkpoints, webhooks, authentication, deployment behavior, and telemetry to ensure reliable operation in customer environments. The position involves close collaboration with open-source, product, and infrastructure teams, with a primary focus on production execution, ensuring agent workflows are resumable, inspectable, authenticated, observable, and scalable.

Requirements

• Strong Python backend/platform engineering experience, with a focus on building production services.
• Experience with FastAPI or similar API frameworks, Celery or other job systems, Redis, Pydantic, and typed Python.
• Good understanding of distributed systems concepts, including retries, idempotency, async execution, status tracking, race conditions, and failure recovery.
• Comfort with authentication and security-sensitive systems such as JWTs, webhooks, signatures, secrets, IAM/workload identity, and least-privilege principles.
• Practical experience with observability tools like tracing, structured logging, metrics, Sentry/OpenTelemetry, and debugging multi-service failures.
• Ability to work effectively at the intersection of an open-source framework and a hosted enterprise platform without creating brittle dependencies.
• Strong testing practices and familiarity with CI, package/version management, and release discipline.

Nice To Haves

• Experience operating AI/agent runtimes, workflow engines, or distributed task systems.
• Cloud platform experience with AWS ECS/ECR, Kubernetes, Helm, GCP/Azure identity, or secret managers.
• Experience with enterprise SaaS constraints such as auditability, tenant isolation, customer environments, deployment rollbacks, and supportability.
• Familiarity with Rails/SaaS platforms.

Responsibilities

• Build and maintain the Python enterprise runtime for CrewAI, including FastAPI services, Celery workers, Redis-backed state, execution APIs, and deployment tools.
• Extend open-source CrewAI functionality for enterprise needs while maintaining compatibility with upstream framework updates.
• Own production execution workflows such as crew and flow kickoff, status tracking, retries, cancellation, checkpoint restoration and forking, chat/session state management, and human-in-the-loop resume capabilities.
• Develop secure integration surfaces, including JWT authentication, signed webhooks, token refresh, file handling, secret fetching, and workload identity across AWS, GCP, and Azure.
• Enhance observability across distributed execution using OpenTelemetry traces, structured logs, Sentry, event tracking, and improve debuggability across API, worker, and platform boundaries.
• Maintain high test coverage for asynchronous and runtime behavior using pytest, mypy, ruff, mocks/fakes, and end-to-end deployment harnesses.
• Collaborate with the Agent Management Platform team on API contracts, versioning, enterprise client behavior, deployment status, and failure reporting.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed