Big Data Engineer III

AAA Northeast•North Providence, RI

1d•$132,000 - $170,000•Remote

About The Position

Big Data Engineer III is responsible for designing, developing, and maintaining large-scale data processing systems. This role includes building and optimizing data pipelines and ETL processes, designing and maintaining data models and architectures, and conducting performance tuning and optimization of data processing systems. Collaboration with data scientists and analysts is essential to deliver actionable insights.

Requirements

Bachelor's Degree Computer science, Information Technology, Engineering, or a related field. required or 6-8 years of additional relevant experience required
5+ years Experience in data engineering or a related field required

Nice To Haves

Master's Degree Computer science, Information Technology, Engineering, or a related field or 5+ YOE of direct experience. preferred
Big data certs, Azure cloud certs, Snowflake certs

Responsibilities

Architect and optimize ETL processes for complex data requirements.
Design advanced data models to support sophisticated data processing needs.
Design and manage robust, scalable data pipelines.
Oversee the management and optimization of databases.
Utilize advanced SQL techniques for complex data operations.
Oversee the implementation and management of NoSQL databases.
Architect and manage data warehousing solutions.
Lead the implementation and optimization of big data technologies.
Manage and optimize distributed computing resources for large-scale data processing.
Build, maintain, and manage data pipelines using cloud technologies, Snowflake, Fivetran, DBT, Airflow.
Utilize cloud platforms for scalable data processing and storage.
Apply DevOps practices to automate and streamline data engineering workflows.
Implement containerization solutions for data processing jobs.
Implement data security measures to protect sensitive information.
Optimize the performance of data processing and storage systems.
Mentor and guide junior engineers, fostering a collaborative and innovative work environment.