Senior Data Engineer

The job overview for this position is that Allergan Data Labs is seeking a Senior Data Engineer to join their team and help transform the Allergan Aesthetics beauty business at AbbVie. The role involves working with cross-functional partners to understand and deliver data needs, championing code quality and scalability, designing and building efficient data pipelines, and developing APIs and microservices. The ideal candidate should have experience in data engineering, SQL and NoSQL databases, Python, Apache Spark, data modeling, and cloud platforms like AWS. This is an opportunity to work in a startup-oriented environment with the support of a large company.

• Work with cross functional partners - Data Scientists, Engineers, Product Managers to understand and deliver data needs.
• Champion code quality, reusability, scalability, security and help make strategic architecture decisions with the lead engineer.
• Design, build and launch extremely efficient and reliable data pipelines to move data across a number of platforms including Data Warehouse, online caches and real-time systems.
• Build product-focused datasets and scalable, fault-tolerant pipelines.
• Build data quality checks, data anomaly detection, and optimize pipelines for ideal compute and storage.
• Develop APIs and Microservices to expose and integrate data products with software systems.
• Write code to extract, ingest, process and store data within SQL, NoSQL and MPP databases like Snowflake.
• Have strong development experience with Python (or Scala/Java).
• Experience with complex SQL, batch and streaming pipelines with Apache Spark framework.
• Knowledge of relational and dimensional data modeling.
• Experience with data quality checks, data validation and data anomaly detection.
• Experience with workflow management engines like Airflow.
• Experience with Git, CI/CD pipelines, Docker, Kubernetes.
• Experience with architecting solutions on AWS or similar public clouds.
• Experience with Microservices and Event Driven Architecture.
• Experience with offline and online feature engineering solutions for Machine Learning.
• Previous domain knowledge in the digital marketing.
• Experience with API development to expose data products.
• Experience with building Data and ML platform/infrastructure.

• 5+ years of experience as a Data Engineer writing code to extract, ingest, process and store data within SQL, NoSQL and MPP databases like Snowflake
• Strong development experience with Python (or Scala/Java)
• Experience with complex SQL, batch and streaming pipelines with Apache Spark framework
• Knowledge of relational and dimensional data modeling
• Experience with data quality checks, data validation and data anomaly detection
• Experience with workflow management engines like Airflow
• Experience with Git, CI/CD pipelines, Docker, Kubernetes
• Experience with architecting solutions on AWS or similar public clouds
• Experience with Microservices and Event Driven Architecture
• Experience with offline and online feature engineering solutions for Machine Learning
• Previous domain knowledge in the digital marketing
• Experience with API development to expose data products
• Experience with building Data and ML platform/infrastructure

• Competitive salary
• Competitive annual bonus targets
• 401k with dollar-for-dollar match, up to 6% of eligible earnings
• RSU grants (Long Term Incentives) for approved roles
• Comprehensive medical, dental, vision, and life insurance
• 17 paid holidays per year, including 3 floating holidays
• Annual Paid Time Off (PTO), with separate sick days
• Generous discounts on SkinMedica skin care products
• Discounted aesthetic treatment days multiple times a year
• $600 worth of Alle benefits each year to use towards aesthetic treatments and products
• Eligible for donation matching to over 1.5 million nonprofit organizations
• Flexible workplace accommodations
• 12 weeks paid Parental Leave
• Caregiver Leave
• Adoption and Surrogacy Assistance Plan
• Tuition reimbursement
• Opportunities to attend Lakers, Knicks, Anaheim Ducks, Anaheim Angels, and NY Rangers games
• Opportunities to attend concerts, festivals, and other live entertainment events
• Attend a tech or marketing conference of your choice each year
• A MacBook Pro and accompanying hardware to do great work
• A modern productivity toolset to get work done: Slack, Miro, Loom, Lucid, Google Docs, Atlassian, and more
• Attend AWS Re:Invent in person (Las Vegas) or virtually each year (for certain roles)