Data Engineer III

Walmart • Bentonville, AR

7d • Onsite

About The Position

The Data Engineer III identifies options to address business problems through analytics, big data analytics, and automation; supports business cases and recommendations; and owns assigned project activities and tasks. The role supports process changes and data governance, applies defined strategies to routine business problems, extracts data, builds and transforms data pipelines, helps identify fit-for-purpose data sources, and performs initial data quality checks.

The position analyzes data elements, systems, flows, dependencies, and relationships to contribute to conceptual, logical, and physical data models, including data warehouse and data mart designs. It defines relational tables, keys, and stored procedures; evaluates models and databases for discrepancies; develops data flows; and proposes solutions to system integration challenges. It also creates training materials, trains end users, and oversees less experienced programmers and troubleshooting support.

The engineer writes and tests code, creates test cases and proofs of concept, deploys software to production, documents code, maintains playbooks, and provides progress updates. The role applies current expertise and best practices while supporting customer and business needs.

The position is based at 811 Excellence Dr., Bentonville, Arkansas. The employer requires a master's degree or equivalent in Computer Science, Engineering, or a related field, or a bachelor's degree or equivalent in one of those fields plus two years of software engineering or related experience. The listed pay range is $110,302 to $180,000 per year, with additional annual or quarterly performance incentives.

Requirements

• Master’s degree or equivalent in Computer Science, Engineering (any), or a related field; alternatively, a bachelor’s degree or equivalent in one of these fields plus two years of software engineering or related experience.
• Experience analyzing business requirements, performing data analysis, and developing technical design documents with product and data teams.
• Experience designing and building scalable, distributed data pipelines and ETL solutions using Spark, Hadoop, Hive, Azure Databricks, Azure Data Factory, Azure Blob Storage, GCP Dataproc, and BigQuery.
• Experience developing data solutions with object-oriented programming in Python and Scala, following industry best practices.
• Experience automating workflows and streamlining processes with Python and shell scripting, and building lightweight ETL frameworks.
• Experience optimizing and tuning Spark applications, including Spark Core, Spark SQL, and Spark Streaming, to improve performance and reduce costs.
• Experience implementing data pipelines on Microsoft Azure, Databricks, Google Cloud Platform, and BigQuery.
• Experience orchestrating workflows with Apache Airflow, Azure Data Factory, GCP Cloud Composer, Automic, and Oozie.
• Experience establishing CI/CD pipelines using GitHub, Jenkins, JFrog, and Artifactory.
• Experience managing code with Git-based version control for collaboration, code review, and release management.
• Experience writing optimized SQL for data extraction, transformation, and warehousing, including Hive and BigQuery.
• Experience collaborating with cross-functional teams to deliver scalable data solutions on time.
• Experience applying Agile and Waterfall methodologies according to project needs.
• Experience designing data models across RDBMS and cloud systems for efficient data access and analytics.
• The employer will accept any amount of experience with the required skills.

Responsibilities

• Identify options for business problems using analytics, big data analytics, and automation; support business cases and recommendations.
• Own assigned project activities and tasks, support process updates and changes, and solve business issues.
• Support documentation and implementation of data governance practices.
• Extract data from identified databases, create data pipelines, transform data for the problem, and perform initial data quality checks.
• Help identify data sources that are fit for purpose and support understanding of requirements priority and service-level agreements.
• Analyze data elements, systems, flows, dependencies, and relationships to contribute to conceptual, logical, and physical data models.
• Develop logical and physical data models, including data warehouse and data mart designs; define relational tables, primary and foreign keys, and stored procedures.
• Evaluate existing data models and physical databases for variances and discrepancies, develop efficient data flows, and propose solutions to data-related integration challenges.
• Create training documentation and train end users on data modeling; oversee tasks of less experienced programmers and provide troubleshooting support.
• Write code to develop solutions and application features based on business, technical, and data requirements.
• Create test cases and proofs of concept, test code, and deploy software to production servers.
• Document code, maintain playbooks, and provide timely progress updates.
• Apply current expertise and best practices, provide advice and guidance, and support alignment with customer and business needs.

Benefits

• Medical, vision, and dental coverage.
• 401(k), stock purchase plan, and company-paid life insurance.
• Paid time off, including sick leave, parental leave, family care leave, bereavement leave, jury duty leave, and voting leave.
• Short-term and long-term disability.
• Education assistance, including 100% company-paid college degrees.
• Company discounts.
• Military service pay.
• Adoption expense reimbursement.
• Annual or quarterly performance incentives. Eligibility and terms may apply.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level