Engineering Manager, Big Data, Job Understanding

ZipRecruiter • San Francisco, CA

6h • $200,000 - $265,000 • Hybrid

About The Position

ZipRecruiter’s Recommendation Ecosystem Group provides backend machine learning and data platforms that connect job seekers to relevant jobs. The Job Understanding team is the authoritative source for foundational job data, pipelines, and matching intelligence. The Engineering Manager leads an experienced engineering team responsible for modernizing core data pipelines, storage solutions, and data access methods while improving data quality and security systems.

The manager leads, mentors, and unblocks five senior engineers who own core job ingestion pipelines and data stores. The role includes rebuilding the job ingestion pipeline, refining how job data is exposed to other engineering teams, improving the quality of underlying input data—including low-structure, user-generated content—and leading improvements to fraud detection and blocking. The manager partners with engineering stakeholders, Data Scientists, and a dedicated Product Manager to balance requests and roadmap priorities.

The team works to process and act on job-related information at scalable, real-time speeds. The role scales data pipelines for performance and maintainability to support broader data collection and personalization of the job seeker experience. ZipRecruiter offers a hybrid work environment; most US-based positions may also be performed remotely, subject to any exceptions in the Minimum Qualifications. This is a full-time position with a US base salary range of $200,000–$265,000. Depending on the position offered, equity, bonuses, commission, or other compensation may also be provided.

Requirements

• At least 5 years of professional software development experience.
• At least 2 years of experience as a software engineering leader.
• Deep experience with modern big data frameworks such as Spark, Hadoop, or Hive.
• Experience with streaming technologies such as Kafka, Flink, or Beam.
• Strong computer science fundamentals, including data structures and algorithms, and strong coding skills.
• Experience with containerization technologies such as Docker and Kubernetes.
• Experience working on a B2C or B2B product.
• Experience dealing with messy or unreliable data, such as third-party datasets, data integrations, or migrations.
• Ability to work with Product Managers to identify problems and turn them into engineering solutions; curiosity, problem-solving ability, and a deep understanding of the product.

Nice To Haves

• Experience with cloud platforms such as GCP, AWS, or Azure.
• Experience with modern data storage solutions such as Delta Lake, HBase, or Hudi.
• Scala experience.

Responsibilities

• Lead, mentor, and unblock a senior team of five engineers responsible for core job ingestion pipelines and data stores.
• Drive the rebuild of the job ingestion pipeline and refine how job data is exposed to consuming engineering teams.
• Prioritize initiatives that improve underlying input data quality and address low-structure, user-generated content.
• Own and lead improvements to fraud detection and blocking mechanisms.
• Partner with engineering stakeholders, Data Scientists, and a dedicated Product Manager to balance requests and roadmap priorities.
• Scale data pipelines for performance and maintainability so the team can process job information in real time, expand data collection, and personalize the job seeker experience.

Benefits

• Competitive compensation.
• Exceptional benefits package.
• Flexible vacation and paid time off.
• Employer-matched 401(k) plan.
• Potential equity, bonuses, commission, or other forms of compensation, depending on the position offered.
• Medical, financial, and other benefits.

What This Job Offers

• Job Type: Full-time
• Career Level: Manager
• Education Level: No Education Listed