Senior Data Engineer

Walmart • Bentonville, AR

12d • Onsite

About The Position

The Senior Data Engineer oversees the work of less experienced programmers and stipulates system troubleshooting support. The role applies data strategy and data engineering practices to routine business problems, including identifying business-relevant data, maintaining data quality and governance, and understanding data accessibility, storage, scalability, and the value of data assets.

The position identifies suitable data sources across business domains and systems, considers data requirements and service-level agreements, and performs initial data quality checks. It extracts data and builds pipelines to transform and integrate internal and external data using methods such as ETL batch processing, streaming ingestion, APIs, scrapers, and crawlers. It works with data warehousing and distributed data technologies, analytical methods, and cloud and big data environments.

The role analyzes data elements, systems, flows, dependencies, and relationships; contributes to conceptual, logical, and physical data models; and develops data warehouse and data mart designs. It defines relational tables, keys, and stored procedures, evaluates existing models and databases, develops efficient data flows, and proposes solutions to data integration challenges. The position also creates data-modeling training documentation and trains end users.

The job is located at 811 Excellence Dr., Bentonville, AR 72716. Compensation is $90,000–$180,000 per year, with additional annual or quarterly performance incentives.

Requirements

• Master’s degree or equivalent in Computer Science or a related field plus 1 year of experience in software engineering, data engineering, database engineering, business intelligence, business analytics, or a related field; OR a Bachelor’s degree or equivalent in Computer Science or a related field plus 3 years of experience in those fields.
• Experience designing and implementing applications with Apache Spark.
• Experience with Hadoop ecosystem components and frameworks, including Hadoop, HDFS, YARN, TEZ, and MapReduce.
• Experience building scripts using Unix Shell Script.
• Experience scheduling production jobs using Apache Airflow and Oozie.
• Experience with Google Cloud Platform to execute applications using clusters and data management.
• Experience writing Hive applications using Hive Query Language.
• Experience with deployment tools Maven and SBT.
• Experience implementing CI/CD pipelines using Jenkins and using Git for source control management.
• Experience using Agile methodologies to track day-to-day sprint tasks and story points with JIRA/Scrum.
• Experience with project management activities, including initiation, planning, execution, monitoring and control, and closure.
• Experience participating in requirements gathering from multiple teams for project increment planning.
• Employer will accept any amount of experience with the required skills.

Responsibilities

• Oversee tasks of less experienced programmers and stipulate system troubleshooting support.
• Apply data strategy and data practices to routine business problems involving a single function.
• Identify data sources, assess data requirements and service-level agreements, select fit-for-purpose data sources, and perform initial data quality checks.
• Extract data from databases and create pipelines to transform and integrate data into structures relevant to the problem.
• Use appropriate data transformation, integration, preprocessing, analytical, cloud, and big data techniques.
• Analyze complex data elements, systems, data flows, dependencies, and relationships to contribute to conceptual, physical, and logical data models.
• Develop logical and physical data models, including data warehouse and data mart designs.
• Define relational tables, primary and foreign keys, and stored procedures to create data-model structures.
• Evaluate existing data models and physical databases for variances and discrepancies.
• Develop efficient data flows and analyze data-related system integration challenges, proposing appropriate solutions.
• Create training documentation and train end users on data modeling.
• Develop knowledge of current data science and analytics trends.

Benefits

• Medical, vision, and dental coverage.
• 401(k).
• Stock purchase.
• Company-paid life insurance.
• Paid time off, including sick leave.
• Parental leave.
• Family care leave.
• Bereavement leave.
• Jury duty and voting leave.
• Short-term and long-term disability.
• Education assistance, including 100% company-paid college degrees.
• Company discounts.
• Military service pay.
• Adoption expense reimbursement.
• Performance-based incentive awards, including annual or quarterly performance incentives.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior