Weekday AI-posted 8 days ago
Full-time • Mid Level
New York, NY
11-50 employees

We are seeking an experienced Python Developer with deep expertise in workflow orchestration frameworks including Celery and Temporal, to join our high-performance engineering team. This role requires strong backend development capabilities, hands-on experience building scalable distributed systems, and the ability to design resilient, fault-tolerant workflows that power complex business processes. The ideal candidate is a self-starter who enjoys solving challenging problems, thrives in fast-paced product environments, and can collaborate effectively across cross-functional teams.

  • Design, develop, and maintain backend services using Python with a focus on performance, reliability, and maintainability.
  • Build and implement distributed task execution and workflow orchestration pipelines using Celery, Temporal, or similar frameworks.
  • Architect scalable workflow solutions and event-driven systems capable of handling high-volume transactions and asynchronous processing.
  • Optimize task scheduling, worker management, queue handling, and checkpointing strategies to ensure high availability.
  • Write clean, testable, reusable, and efficient code following engineering best practices and internal guidelines.
  • Collaborate with product managers, architects, SRE teams, and other developers to translate business requirements into engineering solutions.
  • Integrate workflows with external systems, including microservices, message queues (e.g., Kafka, RabbitMQ, SQS), databases, and APIs.
  • Manage production deployments, monitor service health, troubleshoot complex issues, perform root-cause analysis, and improve reliability metrics.
  • Maintain documentation including workflow diagrams, technical designs, system architecture details, and knowledge-base records.
  • Mentor junior engineers, participate in peer code reviews, and contribute to continuous improvement initiatives.
  • Stay updated with new technologies in workflow orchestration, distributed computing, cloud platforms, and process automation.
  • 6–13 years of professional software development experience, with a strong focus on backend development.
  • Expertise in Python including asynchronous programming, concurrent execution, multiprocessing, and performance tuning.
  • Strong hands-on experience in Celery and/or Temporal, including workflow creation, signal handling, retry logic, and DAG-based orchestration.
  • Solid understanding of distributed systems, microservices, event-driven architecture, and message queueing concepts.
  • Experience with relational and NoSQL databases such as PostgreSQL, MySQL, MongoDB, Redis, or Cassandra.
  • Experience integrating and deploying services using Docker and Kubernetes is a strong advantage.
  • Familiarity with logging, observability, monitoring tools (Grafana, Prometheus, ELK/EFK, OpenTelemetry).
  • Strong understanding of design patterns, software architecture principles, API development, and performance optimization.
  • Ability to work independently, make technical decisions, and manage priorities in dynamic environments.
  • Strong analytical thinking, problem-solving skills, and excellent communication ability.
  • Prior experience in workflow orchestration for large-scale data processing or automation platforms.
  • Cloud experience (AWS, GCP, or Azure) including serverless or container-based deployments.
  • Experience with CI/CD pipelines and DevOps best practices.
  • Exposure to fault-tolerant distributed frameworks or data streaming tools.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service