Engineering Manager, Big Data, Job Understanding
About The Position
ZipRecruiter’s Recommendations Ecosystem group provides the backend machine learning and data platforms that connect job seekers to the right jobs. Within the group, the Job Understanding team is the authoritative source for foundational job data, pipelines, and matching intelligence. The Engineering Manager will lead an experienced, high-impact team as it modernizes core data pipelines, storage solutions, and access methods while improving data quality and security systems. The manager will lead, mentor, and unblock five engineers responsible for core job-ingestion pipelines and data stores. They will drive a rebuild of the ingestion pipeline, improve how job data is exposed to consuming engineering teams, prioritize improvements to input data quality and the handling of low-structure, user-generated content, and lead enhancements to fraud detection and blocking mechanisms. The role partners with engineering stakeholders, Data Scientists, and a dedicated Product Manager to balance requests and roadmap priorities. The team aims to act on everything it learns about jobs in a scalable, real-time manner. The manager will scale pipelines for performance and maintainability to support broader data collection and personalization of the job-seeker experience. ZipRecruiter offers a hybrid work environment; most US-based positions can also be performed remotely, subject to any exceptions in the Minimum Qualifications.
Requirements
- At least 5 years of professional software development experience.
- At least 2 years of experience as a software engineering leader.
- Deep experience with modern big data frameworks such as Spark, Hadoop, and Hive.
- Experience with streaming technologies such as Kafka, Flink, or Beam.
- Strong computer science fundamentals, including data structures and algorithms, and strong coding skills.
- Experience with containerization technologies such as Docker and Kubernetes.
- Experience working on a B2C or B2B product.
- Experience working with messy or unreliable data, such as third-party datasets, data integrations, or migrations.
- Ability to work with Product Managers to identify problems and turn them into engineering solutions, with curiosity, problem-solving ability, and a deep understanding of the product.
Nice To Haves
- Experience with cloud platforms such as GCP, AWS, or Azure.
- Experience with modern data storage solutions such as Delta Lake, HBase, or Hudi.
- Scala.
Responsibilities
- Lead, mentor, and unblock a senior team of five engineers responsible for core job-ingestion pipelines and data stores.
- Drive the rebuild of the job-ingestion pipeline and refine how job data is exposed to consuming engineering teams.
- Prioritize initiatives that improve underlying input data quality and handle low-structure, user-generated content.
- Own and lead improvements to fraud detection and blocking mechanisms.
- Partner with engineering stakeholders, Data Scientists, and a dedicated Product Manager to balance requests and roadmap priorities.
- Scale data pipelines for performance and maintainability so the team can act on job data in a scalable, real-time manner and support broader data collection and personalization.
Benefits
- Competitive compensation.
- Exceptional benefits package.
- Flexible vacation and paid time off.
- Employer-matched 401(k) plan.
- Depending on the position offered, equity, bonuses, commission, or other forms of compensation may be provided.
- Medical, financial, and other benefits.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Manager
Education Level
No Education Listed
