About The Position
Zyte is hiring a Software Engineer for its Edge Platform squad, which owns the control plane and data plane of a residential device network operating across Windows, Android, and Linux. Edge serves as the most resilient tier of Zyte API’s web-fetching system, using real devices to reach targets that other routes cannot. The existing system includes a Rust peer on residential Windows PCs, a command-and-control service using mTLS gRPC, a fetch scheduler, and a CONNECT proxy gateway. The platform is being expanded to support tens of millions of requests per day and multiple device providers. The engineer will design and operate a Fleet Manager control plane alongside the existing data plane. This includes provider adapters, fleet reconciliation, health and configuration management, software rollout control, and metrics export. The role also covers scaling the fetch scheduler, improving proxy and session handling, engineering networking across unreliable residential connections, and ensuring service reliability. The engineer will work with the Team Lead, a Principal Engineer, and partner engineering squads, while contributing to production operations, design reviews, and technical proposals. Zyte is a remote-first, globally distributed company. Its engineering environment emphasizes production-grade solutions, systematic system design, ownership, and real-world distributed-systems challenges. The technology stack includes Rust, gRPC, Kubernetes, GCP, and a range of networking, data, and observability technologies.
Requirements
- At least 5 years of production Rust experience, including shipping and operating services end to end.
- Experience designing and operating schedulers, control planes, or stateful services at scale, with the ability to reason about consistency, partitions, backpressure, and idempotency.
- Deep knowledge of TCP, TLS, and HTTP at the handshake and packet level; gRPC and long-lived connections across NAT and lossy links; and client behavior on the wire.
- Experience building or operating forward proxies, proxy gateways, or residential/ISP proxy infrastructure, including understanding of IP reputation, session stickiness, and pool health.
- Experience with SLOs, error budgets, building observability, leading production incidents, and participating in on-call.
- Comfort working with Rust on Windows, Linux, and Android targets, including FFI boundaries where needed.
- Strong written communication skills for a globally distributed, remote-first environment.
- Curiosity about system behavior under load and a focus on fixing root causes.
Nice To Haves
- Experience shipping Rust on Android, Windows, or macOS, or binding Rust to C/C++ through FFI.
- Experience with fleet or device management, including reconcilers, rollout controllers, IoT, or volunteer-computing fleets.
- Understanding how TLS, HTTP, and IP signals are used to classify traffic for anti-bot and fingerprinting purposes.
- Familiarity with the technical challenges of large-scale web data extraction through web scraping or crawling.
- Contributions to Rust, networking, or distributed-systems open-source projects.
Responsibilities
- Evolve the CNC data plane into a horizontally scalable fetch scheduler that handles 50–100 million requests per day while respecting geo-routing, site cooldowns, jail and per-peer quotas, and avoiding detectable patterns.
- Design and ship the Fleet Manager control plane, including provider adapters, reconciliation, rollout control, inventory, health and configuration management, and metrics export to BigQuery.
- Operate and improve the CONNECT proxy gateway and edge session handling; coordinate with the API squad on IP reputation, proxy leases, and request scheduling.
- Engineer mTLS gRPC communications, long-polling and streaming over unreliable residential links, NAT and carrier-grade NAT behavior, and accurate bandwidth accounting under contention.
- Define SLOs for Edge route availability, success, and latency; build metrics for peer count, drop-off, and bandwidth; and safely run blue/green rollouts of CNC and peers.
- Participate in the squad’s on-call rotation, lead incident post-mortems, and translate operational lessons into platform improvements.
- Write RFDs for scheduling, fleet management, and failover; review designs across the squad; and apply distributed-systems principles including consistency, backpressure, idempotency, and blast-radius management.
Benefits
- Freedom and flexibility to work from where you do your best work.
- Flexible working hours.
- Conference attendance and opportunities to meet team members from across the globe.
- Work with cutting-edge open-source technologies and tools.
- Work with a self-motivated, progressive, multicultural team.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
