Data Engineer

Avalore•Arlington, VA

6d•Onsite

About The Position

The Data Engineer will design, build, and maintain the core WDP data infrastructure and pipelines necessary to ingest, process, store, and transform data for various consumers. This person will develop and operate automated, end-to-end data pipelines, create and maintain data models and schemas, and contribute to the overall scalability, reliability, and security of the data platform. This person will implement data processing frameworks and technologies, design and optimize data storage solutions, and develop data transformation logic to support analytics requirements. This person will implement data quality checks and validation procedures, establish data lineage tracking mechanisms, and troubleshoot data pipeline issues. This person will collaborate with data scientists and analysts to understand data requirements, work with security teams to implement data protection measures, and stay current with data engineering technologies and best practices. This person will document data architecture and pipelines, participate in data governance activities, and contribute to continuous improvement of data engineering processes.

Requirements

SECRET Security Clearance Required
Cloud+, GSEC, Security+, or SSCP certification (for Junior/Journeyman roles)
SecurityX/CASP+, CCNP Security, CISA, CCSP, CISSP (for Senior roles)
Junior: 0 - 3 years of experience + Bachelor's Degree
Journeyman: 4 - 7 years of experience + Bachelor's Degree
Senior: 8+ years of experience + Bachelor's Degree
Good communication skills
Self-starter mindset
Professional proficiency in English is required
Demonstrated proficiency in using all Microsoft Office applications
Applicants must be currently authorized to work in the United States on a full-time basis.
Avalore will not sponsor applicants for work visas for this position.

Responsibilities

Design, build, and maintain the core WDP data infrastructure and pipelines necessary to ingest, process, store, and transform data for various consumers.
Develop and operate automated, end-to-end data pipelines.
Create and maintain data models and schemas.
Contribute to the overall scalability, reliability, and security of the data platform.
Implement data processing frameworks and technologies.
Design and optimize data storage solutions.
Develop data transformation logic to support analytics requirements.
Implement data quality checks and validation procedures.
Establish data lineage tracking mechanisms.
Troubleshoot data pipeline issues.
Collaborate with data scientists and analysts to understand data requirements.
Work with security teams to implement data protection measures.
Stay current with data engineering technologies and best practices.
Document data architecture and pipelines.
Participate in data governance activities.
Contribute to continuous improvement of data engineering processes.