Big Data Engineer

ZipRecruiter is seeking a passionate Big Data Engineer with expertise in cloud technologies, big data, and distributed systems to join their product teams. The role involves designing and building key components and infrastructure for their data science and engineering team. The engineer will be responsible for building infrastructure to empower fellow engineers and data scientists, working in a high-volume production environment, and mastering scalability and enterprise-grade production services implementation. They will also collaborate with a highly skilled team and work with modern technologies such as Spark, Delta Lake, Elasticsearch, Kafka, DynamoDB, and K8s.

- Build infrastructure to empower engineers and data scientists to develop machine learning based products - Work in a high-volume production environment - Master scalability and implement enterprise-grade production services - Lead design for new products and initiatives - Integrate with currently implemented best practices - Work with modern technologies such as Spark, Delta Lake, Elasticsearch, Kafka, DynamoDB, K8s, etc. - Collaborate and work as part of a highly skilled team

- 4+ years of coding experience with Python or Scala - End-to-end experience in owning features from idea stage to deployment - Experience with Spark, Flink, or MapRed technologies

- Hybrid work environment with the option to work remotely for most US-based positions - Opportunity to work from the Saarona, Tel Aviv office for Israel-based positions - Empowering, fun, and collaborative culture - Opportunity to work with AI-driven smart matching technology - Partnership with the best job sites on the web - #1 rated job search app on iOS & Android - Opportunity to work with models and algorithms of machine-learning and deep-learning - Design and build key components and infrastructure for data science and engineering team - Build infrastructure to empower engineers and data scientists - Work in a high-volume production environment - Master scalability and enterprise-grade production services implementation - Sense of ownership in leading design for new products and initiatives - Work with modern technologies including Spark, Delta Lake, Elasticsearch, Kafka, DynamoDB, K8s, and more - Collaborate and work as part of a highly skilled team - Competitive salary - Exceptional benefits package - Equal employment opportunities for all employees and applicants