Senior Software Engineer, Dataplane Management

Astronomer-posted 3 months ago

$180,000 - $210,000/Yr

Senior

San Francisco, CA

251-500 employees

Resume

Match Score

Upload and Match ResumeTrack Jobs with Teal

At Astronomer, we’re redefining how companies run Apache Airflow at scale. Our R&D organization is home to some of the most innovative minds in cloud infrastructure and open-source software. We’re looking for a Senior Software Engineer to join our Data Plane Management team, whose mission is to efficiently operate, and develop new features for, the cloud compute foundation that our customer Airflow deployments are hosted upon. This is a particularly fascinating role for someone who loves the challenge of managing a large scale fleet of 500+ Kubernetes clusters with a true software engineering mindset. This team owns the compute & network primatives in our Astro platform, developing the APIs that our customers to stand up their environments. It has a full roadmap to add new self-service features such as failover cluster support, VPC/VNet peering, Transit Gateway wiring, and metric/log shipping.

Own key endpoints and features of our flagship product, Astro, to extend our offering to more complex customer networking options.
Work across domains to develop diverse features for our core infrastructure (ie: workload identity, multitenancy, cross region disaster recovery, cloud quota management, private network access).
Evolve our fleet orchestration system to allow us to be able to safely make (and roll back) changes across our infrastructure, and to enable us to scale from the 500+ clusters we have now to thousands in the future.
Develop your experience working in a multi-cloud environment, working with managed K8S offerings and network/authnz primitives from AWS, Azure, GCP.
Deepen your operational knowledge of k8s-based workloads, managing the data pipelines of many of the largest companies in the world.

Experience building and operating SaaS infrastructure, or experience managing a large scale internal compute platform.
Software engineering expertise with Golang, or similar languages with a desire to learn Golang.
A passion for reliability and operational excellence. A low tolerance for toil, alert fatigue, and other nonsense.
Production experience with a container based orchestration system (Kubernetes preferred, but not essential).
Understanding of how to build with security and isolation in mind, so that Astronomer’s managed platform can securely integrate with any customer environment, and to ensure strict isolation between customer workloads.
Strong communication skills, both written and verbal, with experience in working with a globally distributed team in delivery.
Proactive approach to identifying and addressing issues, with a focus on ownership and accountability.
Experience as part of an on-call rotation - this role involves periodic on-call for the services and system we own.

Experience working on a SaaS/PaaS product across multiple cloud providers, with a ‘single tenant data plane’ model.
Programmatically administered Kubernetes in multiple clouds.
Experience designing systems for resiliency, scale and security. A familiarity with Non-Abstract Systems design is a major plus.
A passion for finding and addressing inefficiencies in code, infrastructure costs, tooling and processes.
Experience with our particular tech stack components and technologies (deep breath): Calico/Cilium, PostgreSQL/Aurora/CloudSQL/etc, OpenTelemetry, Chronosphere (Prometheus), Splunk, Istio, Karpenter, Falco.
Experience of the innards and quirks of AWS, GCP and Azure.
Experience with Apache Airflow.

Estimated salary range from $180,000 - $210,000 based on leveling and geography.
Equity component.
Comprehensive benefits package.

Track Jobs with Teal

Job Search Resources

•

AI Resume Builder

•

Senior Data Engineer Resume Examples

•

Senior Data Engineer Cover Letter Examples

Senior Software Engineer, Dataplane Management

Job Search Resources

Tools

Career Hubs

Guides

Company