(USA) Staff, Data Assurance Engineer

Walmart • Herndon, VA

22h • $132,000 - $264,000 • Onsite

About The Position

Role summary: We are seeking a skilled Data Engineer to design, develop, and maintain data pipelines for processing and analyzing large-scale datasets across teams. This role will focus on orchestrating data workflows in a containerized environment, primarily using Python, to build scalable ETL solutions. The ideal candidate will have experience working with large-scale datasets, optimizing data workflows, and integrating with distributed computing frameworks. About the team: The UEBA team consists of skilled Data Scientists and Analysts dedicated to reducing attack risks through proactive threat detection. Utilizing advanced analytics and machine learning, the team collaborates closely with various Information Security groups to enhance cybersecurity measures. Their work involves continuous monitoring, data analysis, and incident management to safeguard organizational assets. By leveraging expertise in cyber risk and information assurance, the team supports the development and implementation of effective security strategies, ensuring robust protection against evolving threats while maintaining high standards of accuracy and reliability in all operations. What you'll do: You will design, develop, and maintain scalable data pipelines to process and analyze log data, leveraging workflow orchestration tools in a containerized environment. Using your advanced expertise in Python and SQL, you will build and optimize ETL processes for efficient log parsing, transformation, and storage. You will work with distributed computing frameworks; integrate with both on-prem, and cloud infrastructure to support high-volume data ingestion. Additionally, you will work closely with data scientists, security analysts, and engineers to provide clean, structured data that supports analytics and decision-making. You will have the opportunity to protect the data of millions of customers, associates, and Walmart’s ever-expanding infrastructure across the globe.

Requirements

• Advanced SQL knowledge and experience working with relational and NoSQL databases.
• Strong programming skills in Python for data processing and analytics.
• Experience with data modeling, data integration, and ETL processes.
• Experience with CI/CD (Continuous Integration/Continuous Deployment) pipelines.
• Proficiency in working with large-scale data sets and distributed computing platform like Kubernetes.
• Familiarity with the use of GitHub for collaborative code management, tracking changes, and code review.
• Proficiency in writing comprehensive technical documentation.
• Experience with data workflow orchestration (e.g., Apache Airflow, Argo Workflows).

Nice To Haves

• Experience with machine learning and data science concepts is a plus.
• Stay up-to-date with the latest industry trends and technologies in data engineering.

Responsibilities

• design, develop, and maintain scalable data pipelines to process and analyze log data, leveraging workflow orchestration tools in a containerized environment
• build and optimize ETL processes for efficient log parsing, transformation, and storage
• work with distributed computing frameworks
• integrate with both on-prem, and cloud infrastructure to support high-volume data ingestion
• work closely with data scientists, security analysts, and engineers to provide clean, structured data that supports analytics and decision-making

Benefits

• At Walmart, we offer competitive pay as well as performance-based bonus awards and other great benefits for a happier mind, body, and wallet.
• Health benefits include medical, vision and dental coverage.
• Financial benefits include 401(k), stock purchase and company-paid life insurance.
• Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting.
• Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.
• You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes.
• Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates.
• Tuition, books, and fees are completely paid for by Walmart.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees