(USA) Senior Data Assurance Engineer

Walmart•Herndon, VA

9d•$108,000 - $216,000

About The Position

Role summary: We are seeking a skilled Data Engineer to design, develop, and maintain data pipelines for processing and analyzing large-scale datasets. This role will focus on orchestrating data workflows in a containerized environment, primarily using Python, to build scalable ETL solutions. The ideal candidate will have experience working with large-scale datasets, optimizing data workflows, and integrating with distributed computing frameworks. About the team: Our UEBA team is comprised of Data Scientists and Analysts with a main goal to mitigate attack risks with proactive threat detection. To accomplish this, we leverage many tools including advanced analytics and machine learning while working closely with many teams across Information Security. What you'll do: You will design, develop, and maintain scalable data pipelines to process and analyze log data, leveraging workflow orchestration tools in a containerized environment. Using your advanced expertise in Python and SQL, you will build and optimize ETL processes for efficient log parsing, transformation, and storage. You will work with distributed computing frameworks; integrate with both on-prem, and cloud infrastructure to support high-volume data ingestion. Additionally, you will work closely with data scientists, security analysts, and engineers to provide clean, structured data that supports analytics and decision-making.

Requirements

SQL knowledge and experience working with relational and NoSQL databases.
Experience with Google Cloud and/or Microsoft Azure.
Understanding of tools such as Power BI, Tableau, or other visualization experience with enterprise data.
Strong programming skills in Python for data processing and analytics.
Experience with data modeling, data integration, and ETL processes.
Experience with CI/CD (Continuous Integration/Continuous Deployment) pipelines.
Proficiency in working with large-scale data sets and distributed computing platform like Kubernetes.
Familiarity with the use of GitHub for collaborative code management, tracking changes, and code review.
Experience with architecture ownership and cross-team collaboration.
Proficiency in writing comprehensive technical documentation.
Experience with data workflow orchestration (e.g., Apache Airflow, Argo Workflows).
Bachelor's degree in computer science, information technology, engineering, information systems, cybersecurity or related area and 3 years’ experience in data assurance at a technology, retail, or data-driven company.
5 years’ experience in data assurance at a technology, retail, or data-driven company.

Nice To Haves

Certification in Security+, Network+, GISF, CISSP, or CCSP
Master’s degree in Computer Science, Information Technology, Engineering, Information Systems, Cybersecurity or related area and 1 year’s Exposure of leading/ working on Information Security / Cybersecurity Projects
candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly.
knowledge of accessibility best practices

Responsibilities

design, develop, and maintain scalable data pipelines to process and analyze log data, leveraging workflow orchestration tools in a containerized environment
build and optimize ETL processes for efficient log parsing, transformation, and storage
integrate with both on-prem, and cloud infrastructure to support high-volume data ingestion
provide clean, structured data that supports analytics and decision-making