Lead Data Engineer - Washington DC - VA (Hybrid).

QTech • Reston, WA

4d • Hybrid

About The Position

We are seeking a Lead Data Engineer with at least 10 years of experience to lead data engineering and cross-functional teams in implementing scalable data platforms for optimal performance. This role requires hands-on experience in developing and updating ETL/ELT scripts, application development (Java), relational database layout, development, and data modeling. The ideal candidate will have experience with the AWS platform, specifically leveraging S3, Kafka, Redshift, and other AWS services, as well as ETL/Data Integration Design and Development using Java/Scala, Spark, preferably on the Cloudera Platform. Strong Java programming skills with enterprise-scale experience and knowledge of database design, implementation concepts, data exchange formats, and data movement concepts are essential.

Requirements

• At least 10 years of experience leading data engineering and cross-functional teams.
• Experience developing and updating ETL/ELT scripts.
• Hands-on experience with application development (Java).
• Hands-on experience with relational database layout, development, data modelling.
• At least 3 years of experience in Data Engineering on AWS platform preferably leveraging S3, Kafka, Redshift and other AWS services.
• ETL/Data Integration Design and Development experience using Java/Scala, Spark preferably on Cloudera Platform.
• Expert Knowledge and understanding of SQL.
• Strong Java Programming with enterprise scale experience (using Git, Artifactory and other DevOps tools).
• Knowledge and understanding of database design and implementation concepts.
• Knowledge and understanding of data exchange formats and data movement concepts.

Responsibilities

• Lead data engineering and cross-functional teams to implement scalable data platforms for optimal performance.
• Develop and update ETL/ELT scripts.
• Engage in application development using Java.
• Perform relational database layout, development, and data modeling.
• Utilize AWS services such as S3, Kafka, and Redshift for data engineering.
• Design and develop ETL/Data Integration solutions using Java/Scala and Spark, preferably on the Cloudera Platform.
• Apply strong Java programming skills with enterprise-scale experience.
• Utilize DevOps tools like Git and Artifactory.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed