Data Engineer, Data Acquisition (Web Crawling & Pipelines)

Vagaro•Pleasanton, CA

1d•Onsite

About The Position

We are seeking a Data Acquisition Engineer to design, build, and scale systems that collect, process, and maintain high-quality external data from the web and third-party sources. This role combines hands-on web crawling, scraping, and data engineering with strong data quality and business alignment for sales, marketing, and product teams. This role is based onsite in Pleasanton, CA Monday through Friday. SPONSORSHIP NOT AVAILABLE FOR THIS POSITION.

Requirements

3+ years of experience in web crawling, scraping, or data engineering
Strong programming skills in Python or JavaScript
Experience with tools like Scrapy, BeautifulSoup, Selenium, or Playwright
Understanding of HTTP, DOM parsing, and web architectures
Strong data cleaning and preprocessing skills
Proficiency in SQL and working with databases
Strong problem-solving skills and attention to detail
Excellent written and verbal communication skills

Nice To Haves

Experience with distributed systems or large-scale data processing
Familiarity with CRM systems like HubSpot or Salesforce
Knowledge of sales and marketing data use cases
Experience with proxy management and crawler scaling
Exposure to AI/ML tools in data workflows

Responsibilities

Design and build scalable web crawlers and scraping systems to extract structured and unstructured data
Collect data from websites, APIs, and databases to support sales and marketing initiatives
Handle dynamic content, pagination, and JavaScript-heavy sites
Perform data cleaning, preprocessing, and validation to ensure accuracy and usability
Deliver clean, structured datasets aligned to business requirements
Collaborate with sales, marketing, and product teams to align data efforts with business goals
Optimize pipelines for performance, scalability, and reliability
Ensure ethical, compliant data collection practices
Build ETL/ELT pipelines for ingestion, transformation, and storage
Implement schema design, deduplication, and change detection
Manage orchestration tools (Airflow, Prefect, etc.)
Work with cloud platforms (AWS, GCP, Azure) and databases

Benefits

Competitive salary
Performance-based bonuses
15 accrued days of PTO
10 company holidays annually
Comprehensive healthcare, dental, and vision plans
Discounts on attractions, theme parks, shows, sports events, movies, hotels, and more through TicketsAtWork
$30/month reimbursement for any Vagaro service, including health, beauty, or wellness treatments
$50 monthly stipend for onsite microkitchen
Complimentary DoorDash DashPass subscription
College Assistance Reimbursement
Access to EAP & Work/Life Programs
LinkedIn Learning account
401k program with 4% matching
Optional life/supplemental insurance
Access to on-site gym
Flavored water dispenser
Basketball court