Senior Data Engineer

Archer Daniels Midland • Decatur, IL

6d • Remote

About The Position

Lead a delivery team to develop data pipelines, transform raw data into useful data systems, and optimize data delivery architecture. Design, build, refactor, and maintain data pipelines using Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark to meet business requirements for reporting, analysis, and data science. Teach, adhere to, and contribute to DataOps and MLOps standards and best practices to continuously improve data system performance. Design and integrate fault tolerance and enhancements into data pipelines to improve quality and performance. Lead and conduct root cause analysis to solve problems, optimize data delivery, and reduce costs. Develop and maintain pricing models and tools to support business decisions. Collaborate with sales, marketing, and finance teams to align pricing strategies with business goals. Create solutions for Prospect-to-Cash, including Order Management and Sales Management. Create solutions for GBS to provide end-to-end solutions.

Requirements

• Master’s degree or foreign equivalent degree in Computer Science, Data Science and Business Analytics, Software Engineering, Information Technology or a related field, and three (3) years of related work experience.
• Three (3) years of experience with/in: At least three (3) of the following cloud-based data systems, such as Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, PySpark, SAP Datasphere, and/or Power BI
• Azure DevOps, GitHub, and CI/CD
• Database storage systems such as cloud, relational, mainframe, data lake, and data warehouse
• Building cloud ETL pipelines using code
• Building ETL platforms utilizing database connections, APIs, or file-based
• Data warehousing concepts and agile methodology
• Designing and coding data manipulations
• Applying processing techniques to extract value from large and disconnected datasets
• Presenting conceptual and technical improvements

Responsibilities

• Lead a delivery team to develop data pipelines, transform raw data into useful data systems, and optimize data delivery architecture.
• Design, build, refactor, and maintain data pipelines using Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark to meet business requirements for reporting, analysis, and data science.
• Teach, adhere to, and contribute to DataOps and MLOps standards and best practices to continuously improve data system performance.
• Design and integrate fault tolerance and enhancements into data pipelines to improve quality and performance.
• Lead and conduct root cause analysis to solve problems, optimize data delivery, and reduce costs.
• Develop and maintain pricing models and tools to support business decisions.
• Collaborate with sales, marketing, and finance teams to align pricing strategies with business goals.
• Create solutions for Prospect-to-Cash, including Order Management and Sales Management.
• Create solutions for GBS to provide end-to-end solutions.

Benefits

• Standard company benefits
• Physical wellness – medical/Rx, dental, vision and on-site wellness center access or gym reimbursement (as applicable).
• Financial wellness – flexible spending accounts, health savings account, 401(k) with matching contributions and cash balance plan, discounted employee stock purchasing program, life insurance, disability, workers’ compensation, legal assistance, identity theft protection.
• Mental and social wellness – Employee Assistance Program (EAP), Employee Resource Groups (ERGs) and Colleague Giving Programs (ADM Cares).
• Paid time off including paid holidays.
• Adoption assistance and paid maternity and parental leave.
• Tuition assistance.
• Company-sponsored training and development resources, such as LinkedIn Learning, language training and mentoring programs.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior