Principal Data Engineer

Walmart • Bentonville, AR

10d • Onsite

About The Position

The Principal Data Engineer translates and co-owns business problems into data-related or mathematical solutions, identifies appropriate methods and tools, and explains how those methods address business needs. The role provides expert advice and guidance, applies current expertise to action plans, and supports efforts aligned with customer and business needs.

The position advises business stakeholders on complex issues, develops project business cases with projected returns or cost savings, translates requirements into work aligned with business strategy, and connects business needs with practical solutions. It also identifies suitable data sources, supports prioritization and service-level requirements, and performs initial data quality checks.

The Principal Data Engineer creates data visualizations for multiple datasets and model outcomes, collaborates with user experience and interface teams as needed, presents findings to technical and business audiences, and mentors junior associates. The role promotes data quality, profiles and validates data, monitors quality measures and service levels, manages quality procedures and cleansing activities, and applies data access and governance policies.

The position also collects and evaluates data for exploratory analysis, supports the selection of statistical techniques, participates in exploratory research projects, and recommends statistical models based on hypotheses. The role is based at 811 Excellence Dr, Bentonville, AR 72716.

The employer requires a master’s degree or equivalent in Computer Science, Information Technology, Engineering, or a related field plus 3 years of software engineering or related experience; 7 years of such experience; or a bachelor’s degree or equivalent in one of those fields plus 5 years of such experience. The employer will accept any amount of experience with the listed required skills. Pay is $129,314–$220,000 per year, with additional annual or quarterly performance incentives. Walmart offers a range of health, financial, paid-time-off, disability, education, and other benefits, subject to eligibility and plan terms.

Requirements

• Master’s degree or equivalent in Computer Science, Information Technology, Engineering, or a related field plus 3 years of software engineering or related experience; OR 7 years of software engineering or related experience; OR bachelor’s degree or equivalent in one of those fields plus 5 years of software engineering or related experience.
• Experience coding in Python, SQL, PySpark, HTML, and Scala.
• Experience designing, building, and maintaining ETL pipelines using Hadoop, Apache Spark, Hive, and BigQuery on cloud platforms such as GCP, AWS, or Azure.
• Experience with data warehousing technologies including Amazon Redshift, Teradata, S3, and BigQuery.
• Experience using SQL, Spark SQL, and NoSQL for data manipulation and retrieval.
• Experience automating scripts, identifying bottlenecks, and designing solutions such as automated pipelines and query optimization.
• Retail and digital advertising experience, including knowledge of KPIs such as CTR and impressions and interpretation of HTML and cookies from backend systems.
• Experience using JIRA, GitHub, and project management tools for sprint planning, backlog management, and progress tracking with dashboards.
• Experience developing dashboards with Power BI, Tableau, and Medallia; designing surveys, defining KPIs, and improving email response rates.
• Experience with hypothesis testing, A/B testing, and machine learning models such as forecasting and regression using Python libraries including Scikit-learn, Pandas, Matplotlib, and Seaborn.
• Experience collaborating with cross-functional teams, contributing to a technical community, and mentoring junior engineers.
• Experience parsing, cleansing, and querying unstructured data in Parquet, JSON, TXT, and CSV formats.
• Experience managing Amazon EC2 instances for scalable cloud computing resources.

Responsibilities

• Translate or co-own business problems into data-related or mathematical solutions and identify appropriate methods and tools.
• Explain use cases and how proposed methods can solve business problems.
• Provide expert advice and guidance and support action plans that meet customer and business needs.
• Recommend solutions to complex business issues and develop project business cases with projected returns or cost savings.
• Translate business requirements into projects, activities, and tasks aligned with business strategy.
• Connect business needs with tangible solutions and identify relevant business insights.
• Identify suitable data sources, support prioritization of requirements and service-level agreements, and perform initial data quality checks.
• Create appropriate visualizations of data and model outcomes for different datasets and customer requirements.
• Collaborate with user experience designers and user interface engineers as needed to build front-end applications.
• Present findings to teams and business audiences, adapt communication to stakeholders, and mentor junior associates on data storytelling.
• Promote data quality awareness; profile, analyze, assess, test, validate, measure, and monitor data quality.
• Deliver data quality service-level agreements and manage operational data quality procedures and issues.
• Lead data cleansing activities, address defects, eliminate unused data, and determine or restrict user access as appropriate.
• Interpret company and regulatory data policies and educate others on data governance processes and guidelines.
• Collect and tabulate data, evaluate accuracy, validity, and applicability, and support the selection and application of statistical techniques.
• Assist with planning, designing, and implementing exploratory data analysis research projects.
• Understand existing statistical models and identify and recommend models based on hypotheses.
• Design, build, and maintain ETL pipelines and data warehousing solutions; automate scripts and address bottlenecks through solutions such as pipeline automation and query optimization.
• Develop dashboards, design surveys, define KPIs, and support improvements to email response rates.
• Use hypothesis testing, A/B testing, and machine learning models for forecasting, regression, exploratory analysis, and insights.
• Collaborate with cross-functional teams, contribute to the technical community, and mentor junior engineers.
• Parse, cleanse, and query unstructured data in multiple formats and manage Amazon EC2 instances.

Benefits

• Competitive pay
• Performance-based incentive awards, including annual or quarterly performance incentives
• Medical coverage
• Vision coverage
• Dental coverage
• 401(k)
• Stock purchase
• Company-paid life insurance
• Paid time off, including sick leave
• Parental leave
• Family care leave
• Bereavement leave
• Jury duty leave
• Voting leave
• Short-term disability
• Long-term disability
• Education assistance, including company-paid college degrees
• Company discounts
• Military service pay
• Adoption expense reimbursement

What This Job Offers

• Job Type: Full-time
• Career Level: Principal