Data Engineer III

Walmart • Bentonville, AR

1d • $110,302 - $180,000 • Onsite

About The Position

The Data Engineer III identifies options for addressing business problems using analytics, big data analytics, and automation; supports business cases and recommendations; owns assigned project tasks; supports process updates; and helps solve business issues. The role supports data-governance documentation and implementation, applies defined strategies to routine single-function business problems, extracts data from identified databases, and builds pipelines that transform data into useful structures. It also contributes to data-source selection, initial data-quality checks, and understanding requirements priorities and service-level agreements.

The position analyzes complex data elements, systems, flows, dependencies, and relationships to contribute to conceptual, logical, and physical data models. It develops logical and physical models, including data warehouse and data mart designs; defines relational tables, keys, and stored procedures; evaluates existing models and databases; develops efficient data flows; and analyzes system integration challenges. The role also creates training documentation, trains end users on data modeling, and oversees tasks of less-experienced programmers while supporting system troubleshooting.

The Data Engineer writes and tests code, selects appropriate programming languages, creates test cases and proofs of concept, and deploys software to production servers. It documents code, maintains playbooks, and provides progress updates. The role applies current expertise to develop and improve action plans, advises others on best practices, aligns work with customer and business needs, and builds commitment for recommendations. The position is based at 811 Excellence Dr., Bentonville, AR 72716.

Requirements

• Master’s degree or equivalent in Computer Science, Engineering (any), or a related field; OR a bachelor’s degree or equivalent in one of these fields plus at least 2 years of experience in software engineering or related experience.
• Experience analyzing business requirements, performing data analysis, and developing technical design documents with product and data teams.
• Experience designing and building scalable, distributed data pipelines and ETL solutions using Spark, Hadoop, Hive, Azure Databricks, Azure Data Factory, Azure Blob Storage, GCP Dataproc, and BigQuery.
• Experience developing data solutions using object-oriented programming in Python and Scala and industry best practices.
• Experience automating workflows and streamlining processes using Python and shell scripting, and building lightweight ETL frameworks.
• Experience optimizing and tuning Spark Core, Spark SQL, and Spark Streaming applications to improve performance and reduce costs.
• Experience implementing data pipelines on Microsoft Azure, Databricks, Google Cloud Platform, and BigQuery.
• Experience orchestrating workflows using Apache Airflow, Azure Data Factory, GCP Cloud Composer, Automic, and Oozie.
• Experience establishing CI/CD pipelines using GitHub, Jenkins, JFrog, and Artifactory.
• Experience managing code with Git-based version control for collaboration, code review, and release management.
• Experience writing optimized SQL for data extraction, transformation, and warehousing, including Hive and BigQuery.
• Experience designing data models across RDBMS and cloud systems to support efficient data access and analytics.
• Employer accepts any amount of experience with the listed skills.

Responsibilities

• Identify options to address business problems through analytics, big data analytics, and automation; support business cases and recommendations.
• Own delivery of assigned project activities and tasks, support process updates and changes, and solve business issues.
• Support documentation and implementation of data-governance processes and practices.
• Extract data, create pipelines, transform data into relevant structures, identify suitable data sources, and perform initial data-quality checks.
• Analyze complex data elements, systems, data flows, dependencies, and relationships to contribute to conceptual, logical, and physical data models.
• Develop logical and physical data models, including data warehouse and data mart designs; define relational tables, primary and foreign keys, and stored procedures.
• Evaluate existing data models and physical databases for variances and discrepancies, develop efficient data flows, and propose solutions to data-related integration challenges.
• Create data-modeling training documentation and train end users; oversee tasks of less-experienced programmers and support system troubleshooting.
• Write code for required solutions and application features, create test cases and proofs of concept, test code, and deploy software to production servers.
• Document code, maintain playbooks, and provide timely progress updates.
• Advise others on information and best practices, align work with customer and business needs, and build commitment for perspectives and rationales.
• Analyze business requirements, perform data analysis, and develop technical design documents in collaboration with product and data teams.
• Collaborate with cross-functional teams to deliver scalable data solutions on time and apply Agile or Waterfall methodologies based on project needs.

Benefits

• Medical, vision, and dental coverage.
• 401(k), stock purchase plan, and company-paid life insurance.
• Paid time off, including sick leave; parental leave; family care leave; bereavement leave; jury duty leave; and voting leave.
• Short-term and long-term disability.
• Education assistance, including 100% company-paid college degrees.
• Company discounts.
• Military service pay.
• Adoption expense reimbursement.
• Performance-based incentive awards, including annual or quarterly performance incentives.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level