Data Engineering Lead
About The Position
The Data Engineer will design, build, and maintain the core client data infrastructure and pipelines necessary to ingest, process, store, and transform data for various consumers. Develop and operate automated, end-to-end data pipelines, create and maintain data models and schemas, and contribute to the overall scalability, reliability, and security of the data platform. Implement data processing frameworks and technologies, design and optimize data storage solutions, and develop data transformation logic to support analytics requirements. Implement data quality checks and validation procedures, establish data lineage tracking mechanisms, and troubleshoot data pipeline issues. Collaborate with data scientists and analysts to understand data requirements, work with security teams to implement data protection measures, and stay current with data engineering technologies and best practices. Document data architecture and pipelines, participate in data governance activities, and contribute to continuous improvement of data engineering processes.
Requirements
- 8 years of experience in data engineering, data pipeline design, and management
- Must meet DoD 8140 requirements
- Bachelor’s degree (or 4 years of additional equivalent experience) in IT, Cybersecurity, Computer Science, Information Systems, Data Science, Software Engineering
- Active TS/SCI clearance
Responsibilities
- Design, build, and maintain core client data infrastructure and pipelines
- Ingest, process, store, and transform data for various consumers
- Develop and operate automated, end-to-end data pipelines
- Create and maintain data models and schemas
- Contribute to the overall scalability, reliability, and security of the data platform
- Implement data processing frameworks and technologies
- Design and optimize data storage solutions
- Develop data transformation logic to support analytics requirements
- Implement data quality checks and validation procedures
- Establish data lineage tracking mechanisms
- Troubleshoot data pipeline issues
- Collaborate with data scientists and analysts to understand data requirements
- Work with security teams to implement data protection measures
- Stay current with data engineering technologies and best practices
- Document data architecture and pipelines
- Participate in data governance activities
- Contribute to continuous improvement of data engineering processes
Benefits
- Hands-on experience
- Certifications
- Industry training
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
