Engineering Manager, Big Data, Job Understanding

ZipRecruiter • Santa Monica, CA

7h • $200,000 - $265,000 • Hybrid

About The Position

ZipRecruiter’s Recommendations Ecosystem Group provides the backend machine learning and data platforms that connect job seekers with jobs. The Job Understanding team is the authoritative source for foundational job data, pipelines, and matching intelligence. The Engineering Manager leads an experienced, high-impact team in modernizing core data pipelines, storage solutions, and access methods while improving data quality and security systems.

The manager leads, mentors, and unblocks five engineers responsible for core job ingestion pipelines and data stores. The role drives the rebuild of the job ingestion pipeline and improves how job data is exposed to engineering teams. It prioritizes better input data quality, addresses low-structure user-generated content, and leads improvements to fraud detection and blocking. The manager partners with engineering stakeholders, data scientists, and a dedicated Product Manager to balance requests and roadmap priorities. The team’s systems must process learnings about jobs at scale in real time, with pipelines designed for performance and maintainability so the company can collect more data and personalize the job seeker experience.

The position is offered in a hybrid work environment. Most US-based positions can also be performed remotely, subject to exceptions noted in the Minimum Qualifications. The stated US base salary range is $200,000–$265,000. Depending on the position offered, equity, bonuses, commission, or other compensation may also be provided.

Requirements

• At least 5 years of professional software development experience.
• At least 2 years of experience as a software engineering leader.
• Deep experience with modern big data frameworks such as Spark, Hadoop, or Hive.
• Experience with streaming technologies such as Kafka, Flink, or Beam.
• Strong computer science fundamentals, including data structures and algorithms, and coding skills.
• Experience with containerization technologies such as Docker and Kubernetes.
• Experience working on a B2C or B2B product.
• Experience discussing problems with Product Managers and translating them into engineering solutions; the posting also emphasizes curiosity, problem-solving, and deep understanding of the product.
• Experience dealing with messy or unreliable data, such as third-party datasets, data integrations, or migrations.

Nice To Haves

• Experience with cloud platforms such as GCP, AWS, or Azure.
• Experience with modern data storage solutions such as Delta Lake, HBase, or Hudi.
• Scala.

Responsibilities

• Lead, mentor, and unblock a senior team of five engineers responsible for core job ingestion pipelines and data stores.
• Drive the rebuild of the job ingestion pipeline and refine how job data is exposed to consuming engineering teams.
• Prioritize initiatives that improve underlying input data quality and handle low-structure, user-generated content.
• Own and lead improvements to fraud detection and blocking mechanisms.
• Partner with engineering stakeholders, data scientists, and a dedicated Product Manager to balance requests and roadmap priorities.
• Ensure the organization can act on job-related information at scale in real time.
• Scale data pipelines for performance and maintainability to support broader data collection and personalization of the job seeker experience.

Benefits

• Competitive compensation.
• Exceptional benefits package.
• Flexible vacation and paid time off.
• Employer-matched 401(k) plan.
• Depending on the position offered, equity, bonuses, commission, or other forms of compensation may be provided.
• Medical, financial, and other benefits.

What This Job Offers

• Job Type: Full-time
• Career Level: Manager
• Education Level: No Education Listed