Engineering Manager, Big Data, Job Understanding

ZipRecruiter•Santa Monica, CA
•Hybrid

About The Position

ZipRecruiter’s Recommendation Ecosystem Group provides the backend machine learning and data platforms that connect job seekers to the right jobs. The Job Understanding team is the authoritative source for foundational job data, pipelines, and matching intelligence. The Engineering Manager will lead an experienced, high-impact team of five engineers responsible for core job ingestion pipelines and data stores. The manager will guide the team in modernizing core data pipelines, storage solutions, and access methods while enhancing data quality and security systems. The role includes driving a rebuild of the job ingestion pipeline, refining how job data is exposed to consuming engineering teams, improving the quality of underlying input data, handling low-structure user-generated content, and improving fraud detection and blocking mechanisms. The manager will partner closely with other Engineering stakeholders, Data Scientists, and a dedicated Product Manager to balance requests and roadmap priorities. The team’s work supports acting on job insights at scale and in real time, and scaling data pipelines for performance and maintainability to enable broader data collection and personalization of the job seeker experience.

Requirements

  • At least 5 years of professional software development experience.
  • At least 2 years of experience as a software engineering leader.
  • Deep experience with modern big data frameworks such as Spark, Hadoop, or Hive.
  • Experience with streaming technologies such as Kafka, Flink, or Beam.
  • Strong computer science fundamentals, including data structures and algorithms, and strong coding skills.
  • Experience with containerization technologies such as Docker and Kubernetes.
  • Experience working on a B2C or B2B product.
  • Ability to work with Product Managers to identify problems and turn them into engineering solutions.
  • Experience dealing with messy or unreliable data, including third-party datasets, data integrations, or migrations.

Nice To Haves

  • Experience with cloud platforms such as GCP, AWS, or Azure.
  • Experience with modern data storage solutions such as Delta Lake, HBase, or Hudi.
  • Scala experience.

Responsibilities

  • Lead, mentor, and unblock a senior team of five engineers responsible for core job ingestion pipelines and data stores.
  • Drive the rebuild of the job ingestion pipeline.
  • Refine how job data is exposed to consuming engineering teams.
  • Prioritize initiatives that improve underlying input data quality and address low-structure, user-generated content.
  • Own and lead improvements to fraud detection and blocking mechanisms.
  • Partner with Engineering stakeholders, Data Scientists, and a dedicated Product Manager to balance requests and roadmap priorities.
  • Ensure job insights can be acted on at scale and in real time.
  • Scale data pipelines for performance and maintainability.

Benefits

  • Competitive compensation.
  • Exceptional benefits package.
  • Flexible vacation and paid time off.
  • Employer-matched 401(k) plan.
  • Equity, bonuses, commission, or other forms of compensation may be provided depending on the position offered.
  • Medical, financial, and other benefits.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service