Staff Data Engineer

Walmart • Bentonville, AR

7d • $127,171 - $220,000 • Onsite

About The Position

The Staff Data Engineer translates business problems into data-related or mathematical solutions, recommends approaches to stakeholders, and connects business requirements with technical solutions. The role identifies suitable data sources, checks data quality, and guides junior associates. It builds and deploys infrastructure, pipelines, and integrations across multiple data sources, using appropriate technologies and orchestration frameworks. The position also shapes complex data for modeling, keeps current with data engineering and analytics trends, and contributes to data architecture and modeling standards.

The engineer reviews solution and application designs, develops and troubleshoots code, creates proofs of concept, maps tests to requirements, and supports deployment, scalability, production monitoring, and patches. The role maintains data documentation and metadata and establishes, implements, and communicates data governance practices in coordination with stakeholders. The position is located at 811 Excellence Dr, Bentonville, AR 72716.

The employer requires a bachelor's degree or equivalent in Computer Science or a related field plus four years of software engineering or related experience, or a master's degree or equivalent in Computer Science or a related field plus two years of such experience. The listed pay range is $127,171 to $220,000 per year, with additional annual or quarterly performance incentives. The employer states that any amount of experience with the required skills will be accepted.

Requirements

• Bachelor's degree or equivalent in Computer Science or a related field plus four years of experience in software engineering or related experience; alternatively, a master's degree or equivalent in Computer Science or a related field plus two years of such experience.
• Experience designing and implementing scalable, optimized, distributed big-data pipelines and ETLs using frameworks such as Hadoop, Hive, Spark, and Databricks.
• Experience developing ETL pipelines using Scala, Python, Spark, and SQL.
• Experience using SQL and Spark SQL for data analysis and validation, and Spark shell scripting for automated data validation.
• Experience documenting data pipelines and workflows using tools such as Confluence, Jira, and Azure DevOps.
• Experience orchestrating and automating pipeline solutions using tools such as Automic, AutoSys, Oozie, and Apache Airflow.
• Experience writing SQL queries for RDBMS and data warehousing frameworks such as Apache Hive and Snowflake.
• Experience developing and maintaining modules in cloud ecosystems such as Google Cloud, AWS, and Azure.
• Experience working with Parquet, AVRO, CSV, ORC, and JSON formats.
• Experience with file-based storage systems including HDFS, GCS, Azure Blob Storage, and S3.
• Experience creating and automating dashboards using Power BI, Tableau, and Looker.
• Experience with system architecture, high-level design through detailed design, and disaster recovery.
• Experience with resource modeling, optimization, and forecasting.
• Experience applying incident management, change management, defect-reduction, and system-reliability processes to improve operational performance.
• Employer will accept any amount of experience with the required skills.

Responsibilities

• Translate and co-own business problems into data-related or mathematical solutions, selecting appropriate methods and tools and explaining how they address business needs.
• Recommend solutions for complex business issues, develop project business cases based on projected return on investment or cost savings, and translate business requirements into work aligned with business strategy.
• Identify suitable data sources based on requirements and service-level agreements, perform initial data-quality checks, and review junior associates’ deliverables and provide guidance.
• Build infrastructure for transforming and integrating data from multiple sources; automate repeatable data preparation tasks and deploy pipelines using scheduling and orchestration frameworks.
• Assess data issues and risks, develop methods to combine and reshape complex multi-source data for modeling, and keep current with emerging big-data analytics and data-science trends.
• Assemble data across platforms and tools; create complex logical and conceptual models; guide physical data modeling; and define techniques for exposing data to other systems.
• Maintain data documentation and metadata, contribute to modeling standards and best practices, and provide architectural design input based on available resources, goals, and expected loads.
• Review solution and application designs against business, technical, and data requirements; select development languages and libraries; map test cases to requirements; and create proofs of concept.
• Troubleshoot code, recommend testing methods and deployment environments, identify environment-specific and scalability changes, monitor production applications, and lead patch development as needed.
• Ensure code documentation is complete and regularly updated.
• Establish, modify, document, and implement data governance projects and practices with business stakeholders and peers; interpret relevant company and regulatory policies; educate others; and recommend policy or guideline updates.
• Lead large-scale projects and provide guidance to team members.

Benefits

• Medical, vision, and dental coverage.
• 401(k), stock purchase plan, and company-paid life insurance.
• Paid time off, including sick leave, parental leave, family care leave, bereavement leave, jury duty leave, and voting leave.
• Short-term and long-term disability coverage.
• Education assistance, including 100% company-paid college degrees.
• Company discounts, military service pay, and adoption expense reimbursement.
• Performance-based incentive awards and annual or quarterly performance incentives.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior