Weekday AI-posted 8 days ago
$180,000 - $280,000/Yr
Full-time • Mid Level
11-50 employees

We are seeking a highly experienced Python Software Engineer to lead backend development for large-scale, real-time data pipelines. The ideal candidate has deep expertise in Python, data ingestion frameworks, workflow orchestration, and performance optimization. This role involves building robust, high-throughput systems that correlate and process data across multiple streams in real time.

  • Architect and develop scalable backend services and data ingestion pipelines using Python.
  • Work with real-time data processing systems to ensure high performance, low latency, and reliability.
  • Build and optimize workflows using Celery, Temporal, or similar orchestration tools.
  • Apply advanced query optimization and data modeling techniques to support high-volume data operations.
  • Collaborate with data platform teams to improve ingestion, transformation, and processing layers.
  • Ensure smooth integration with third-party tools, security systems, and cloud-based environments.
  • Troubleshoot pipeline issues and drive system improvements for scalability and efficiency.
  • Extensive hands-on experience with Python for backend engineering.
  • Strong background in data ingestion pipelines and real-time data processing.
  • Expertise in Celery, Temporal, or other workflow automation/orchestration systems.
  • Solid understanding of distributed systems, query optimization, and data platform architecture.
  • Experience working with high-volume, high-frequency data streams.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service