Senior Data Quality Engineer - Labor Management Forecasting

Publix • Lakeland, FL

66d • $114,855 - $172,315 • Hybrid

About The Position

Become part of the Labor Management team, designing, building, and delivering a robust application that supports Publix business areas in managing labor activities such as forecasting, time attendance and scheduling. In this role, you will own data processing validation and transformation, build and maintain scalable data pipelines, and manage Azure and on-prem data services. This is a hybrid role located in Lakeland, FL, requiring candidates to reside within a commutable distance. The interview process includes at least one onsite interview at our Lakeland, FL campus.

Requirements

• Bachelor’s degree in management information systems, Computer Science, Business, or other analytical disciplines or equivalent experience
• 5+ years of experience in application design, development, and delivery in an enterprise environment
• 5+ years of experience developing large-scale data manipulation processes.
• 5+ years of experience working with relational databases.
• 5+ years of experience implementing large scale enterprise applications.
• 5+ years of experience in analyzing complex, enterprise business problems or processes and translating business requirements into technology solutions that factor in system performance, usability, quality, cross-system interdependencies, scalability, and total cost of ownership.
• 2+ years of experience utilizing Databricks for Python
• Proficient in writing complex queries using an ANSI-compliant SQL language against an enterprise relational database management system.
• Experience planning and managing all activities associated with delivering solutions in a large-scale distributed environment.

Nice To Haves

• 7+ years of experience in application design, development, and delivery in an enterprise environment
• 7+ years of experience developing large-scale data manipulation processes.
• 7+ years of experience working with relational databases.
• 7+ years of experience implementing large scale enterprise applications.
• 7+ years of experience in analyzing complex, enterprise business problems or processes and translating business requirements into technology solutions that factor in system performance, usability, quality, cross-system interdependencies, scalability, and total cost of ownership.
• Experience in implementing enterprise applications using platform services like azure App service, Azure SQL, Azure Service Bus, notification hubs, event hubs, Microservices, stream analytics, Snowflake DB, Redis Cache, OpenAPI, IoT Hub, application insights, etc.
• Experience with Azure DevOps for managing project tasks, managing code repositories, and creating yaml pipelines for CI/CD builds and deployments.
• Azure AZ-305 certification or equivalent experience in designing/architecting Azure solutions
• Experience with C# and/or Python development
• Experience with Unity Catalog, Data/Delta Lake
• Experience with advanced ML specializations (AutoML, forecasting, ensemble methods)

Responsibilities

• Design and implement secure, scalable ingestion frameworks to migrate data from on prem SQL Server databases into Azure Data Lake using standardized patterns
• Develop and maintain reusable transformation frameworks (e.g., medallion architecture: bronze/silver/gold) to standardize data modeling, improve data reliability, and accelerate downstream analytics and reporting
• Establish data governance, security, and compliance controls across the lakehouse, including data classification, access controls, lineage, and auditing to ensure enterprise and regulatory standards are met
• Design, implement, and monitor data quality events to detect, alert, and resolve data anomalies across pipelines and platforms
• Provide hands-on development, deployment, maintenance, and optimization of data pipelines and workflows using Databricks.
• Collaborate with technical teams and other cross-functional stakeholders to understand requirements, design solutions, and implement them using Databricks' platform.
• Optimize and tune Databricks jobs for performance and scalability.
• Assist technical team through problem determination and resolution on highly complex problems.
• Maintain strong analytical, planning, problem solving, writing, and presentation skills.

Benefits

• Employee stock ownership plan that contributes Publix stock to associates each year at no cost
• An opportunity to purchase additional shares of our privately-held stock
• 401(k) retirement savings plan
• Group health, dental and vision plans
• Paid Time Off
• Paid Parental Leave
• Short- and long-term disability insurance
• Tuition reimbursement
• Free hot lunches (buffet-style) at facilities with a cafeteria

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Associate degree