Principal Engineer, Big Data Platform
About The Position
We’re looking for a principal software engineer to lead the next generation of data infrastructure at Pinterest which powers mission critical big data and AI applications. You’ll be working on some of the most exciting big data and AI open source technologies (Flink, Spark, Kubernetes, etc.), at the scale of exabytes of data to help Pinners discover and do what they love. At Pinterest, AI isn't just a feature, it's a powerful partner that augments our creativity and amplifies our impact, and we’re looking for candidates who are excited to be a part of that. Through our interview process, what matters most is that you can always explain your approach, showing us not just what you know, but how you think.
Requirements
- 12+ years of industry experience with a proven track record of technical excellence
- 8+ years of experience of building and support large scalable Kubernetes or big data platform
- Deep knowledge of big data / ML technologies (e.g. Flink, Spark, Presto, Kubernetes, Ray, PyTorch/TensorFlow)
- Proficiency in one or more programming languages (Java, Go, Scala, Python)
- Experiences in Kubernetes and AWS technologies
- Exceptional collaboration skills with cross-functional partners, with the ability to navigate ambiguity, make tradeoffs, and keep stakeholders aligned on priorities and progress.
- Bachelor’s degree in Computer Science, a related technical field, or equivalent experience.
Responsibilities
- Lead the strategy and technical direction of Pinterest’s data infrastructure for big data and AI applications
- Build and scale data infra frameworks and infrastructure to process petabytes-scale datasets, including compute engines, job management, resource management, scheduling and remote shuffling
- Work with internal customers on critical business use cases that rely on big data
- Provide thought leadership to the entire company on how data should be processed and stored more reliably, quickly and efficiently at scale
- Contribute to the team’s technical vision and long-term roadmap
Benefits
- The position is also eligible for equity.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Principal
