Data Engineer II

Intelliswift Software • Santa Clara, CA

80d • $65 - $70

About The Position

A Data Engineer in Content Data Platform is responsible for developing, maintaining, and enhancing Video's Supply Chain data based datasets which are used for Analytics, Machine learning models and Operational use cases. Additionally, they must build and manage the platform for building these datasets and improve core infrastructure for Analytics applications. The Data Platform Engineering team, within the Content & Data Platform (CDP) org owns Lakehouse, a data platform that decouples and streamlines the management and access of PV content data from different data domains of the Content supply chain through different data offerings.

Requirements

• 3-6 years of related experience.
• Strong analytical skills and enjoys working with large, complex data sets.
• Strong knowledge of SQL.
• Hands-on experience with Python.
• Ability to partner with business owners directly to understand their requirements and provide data that can help them observe patterns and spot anomalies.
• Coding (SQL/Problem Solving) - 3 years.
• Data Engineering (Designing ETL Workflows, Understanding DB Concepts/Architecture, Handling Big Data Volumes) - 5 years.
• Performance (Measurement, Indexes, Partitioning, and Tuning) - 2 years.
• Design (Data Modeling (DM), Trade-offs, De/De-normalization, Usability of DM) - 3 years.

Nice To Haves

• Experience with AWS technologies like Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions.
• Experience with Redshift, Oracle, NoSQL etc.
• Experience with big data technologies such as: Hadoop, Hive, Spark, EMR.

Responsibilities

• As a Data Engineer you will be working in one of the world's largest and most complex data warehouse environments.
• You will work with business customers in understanding the business requirements and implementing solutions.
• Build datasets
• Create Data pipelines

Benefits

• Pay rate range - $65/hr. to $70/hr. on W2.
• 5 days in the office.

What This Job Offers

• Industry: Professional, Scientific, and Technical Services