Senior Software Engineer, Backend
ProRata.ai•Bellevue, WA
55d•$160,000 - $200,000•Onsite
About The Position
We are seeking a talented Senior Software Engineer to join us as part of our core engineering team. In this role, you will be in the heart of our mission and responsible for designing and building our next generation of ProRata’s large-scale distributed web crawling infrastructure. This is a high-impact role that is perfect for someone who thrives on solving complex systems problems and continuously improving performance.
Requirements
- 7+ years of experience in backend development, with strong proficiency in Java.
- Solid understanding of data structures, algorithms, and system design fundamentals.
- Experience with relational databases (e.g., PostgreSQL, MySQL).
- Hands-on experience with NoSQL databases (e.g., MongoDB).
- Practical knowledge of Docker and an understanding of Kubernetes or container orchestration.
- Proven track record of building and scaling large distributed or data-intensive systems.
- Familiarity with OpenTelemetry or similar frameworks for tracing, metrics, and logging.
- Experience with Apache Storm or other real-time processing systems is a plus.
- Prior experience developing or maintaining large-scale web crawlers is highly desirable.
Nice To Haves
- Experience with ClickHouse for large-scale analytical workloads.
- Familiarity with message queues (Kafka, RabbitMQ) or distributed task schedulers.
- Experience with cloud infrastructure (AWS, GCP, or Azure).
- Exposure to asynchronous or event-driven architectures.
Responsibilities
- Design and develop high-scale, fault-tolerant crawler systems that ingest and process massive amounts of web data.
- Own the full lifecycle of crawler components — from architecture and design to deployment, monitoring, and continuous optimization.
- Collaborate with other engineering teams to ensure seamless integration of crawlers within broader ecosystem.
- Iterate rapidly to enhance system performance, scalability, and reliability through data-driven experimentation.
- Build automation agents for post crawl verifications.
- Implement observability across crawler services using OpenTelemetry and modern monitoring tools to ensure system transparency and health.
- Champion best practices in distributed systems design, code quality, and operational excellence.
Benefits
- Opportunity to work at the forefront of AI technology
- Collaborative and innovative work environment
- Competitive salary and benefits package
- Professional development and growth opportunities
- Chance to make a significant impact on the company's success
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
Number of Employees
11-50 employees
