Data Engineer (SME)

BAE Systems•Herndon, VA

3d•$146,670 - $249,330•Hybrid

About The Position

As a Data Engineer, you are responsible for designing data models, building data warehouses and data lakes, automating data pipelines and working with datasets of all sizes. You will optimize overall data/information flow by reducing redundancy and enabling accessibility within security boundaries. You apply data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources. You create data collection frameworks for structured and unstructured data. Your solutions and create cyber and operational analytic tools for consumers that assist them in building and optimizing downstream products inclusive of constructing dataset procedures that can help with data mining, modeling, and production. You use and develop standards, tools, processes and governance for capturing, modeling, storing, and delivering data for the enterprise.

Requirements

Minimum of 16 years' experience
Experience integrating diverse data streams into a data lake
Experience with ETL and ensuring unstructured data is structured at time of load
Experience with data transfer tools (Ex: NiFi, Cribl, etc)
Establishes data standards and acts as custodian of IT and service delivery data sets and streams
Experience in analyzing complex networks and systems
Experience in analyzing log data from various network components and operating systems
Knowledge of complex environments involving shared networks and multiple security enclaves
Systems Engineer with Data Engineer background
Ability to manage and troubleshoot data feeds
Python & BASH Scripting
Splunk CORE User certification prior to start

Nice To Haves

Splunk CORE Power User certification 3 months from start
Security Development and Operations (SecDevOps)
Hands on Splunk Experience and Certifications
Scripting tools to include Python, ShellScript, or Ansible
Cloud security controls and implementation
Public, private and hybrid Cloud experience (AWS, Microsoft Azure, etc.)
AWS Certified Security Specialty

Responsibilities

Designing data models
Building data warehouses and data lakes
Automating data pipelines
Working with datasets of all sizes
Optimizing overall data/information flow by reducing redundancy and enabling accessibility within security boundaries
Applying data extraction, transformation and loading techniques to connect large data sets from a variety of sources
Creating data collection frameworks for structured and unstructured data
Creating cyber and operational analytic tools for consumers that assist them in building and optimizing downstream products inclusive of constructing dataset procedures that can help with data mining, modeling, and production
Using and developing standards, tools, processes and governance for capturing, modeling, storing, and delivering data for the enterprise