Principal, Data Engineering

Cargill • Atlanta, GA

1d • Onsite

About The Position

The Principal, Data Engineering job provides thought leadership in the execution of strategic plans related to design, development and maintenance of robust data systems. As a recognized subject matter expert in the field, this job leads the development of efficient processing and availability of data for analysis and reporting.

Requirements

• Minimum requirement of 6 years of relevant work experience.
• Typically reflects 10 years or more of relevant experience.
• Defines long-term technical direction, establishes best practices, and ensures solutions are scalable, maintainable, and aligned with enterprise strategy.
• Champions reliability, observability, and performance, ensuring data systems meet high standards for availability and quality.
• Evaluates competing priorities such as speed, cost, risk, and flexibility to make sound technical and architectural decisions.
• Deep expertise implementing cloud-based data warehouses, data lakes, and open table formats in large-scale production environments.
• Hands-on experience with technologies such as Snowflake, AWS, and open lake house ecosystems.
• Demonstrated proficiency in data collection, ingestion tools (Kafka, AWS Glue), and storage formats (Iceberg, Parquet).
• Experience developing data pipelines with streaming architectures and tools (Kafka, Flink).
• Strong background with using Spark for data transformation, including streaming, performance tuning, and debugging with Spark UI.
• Extensive experience in DevOps practices, including code management, CI/CD, and deployment strategies.

Responsibilities

• Provides thought leadership on the design and development of data pipelines that facilitate the movement of data from various sources to internal databases.
• Influences the construction and optimization of data infrastructure, providing appropriate data formats to ensure data readiness for analysis.
• Examines and sees improvement opportunities for appropriate data formats to optimize data usability and accessibility across the organization.
• Cultivates positive relationships and partners to understand data needs and encourage alignment with organizational objectives.
• Develops and guides the implementation of data products and solutions using advanced engineering and cloud-based technologies, ensuring they are designed and built to be scalable, sustainable, and robust.
• Leads efforts to improve the development of technical products and solutions driving big data and cloud-based technologies, ensuring they are designed and built to be scalable, sustainable, and robust.
• Drives development standards and brings forward prototypes to test new data framework concepts and architecture patterns supporting efficient data processing and analysis and promoting standard methodologies in data management.
• Builds automated reporting systems that provide timely insights and facilitate data driven decision making.
• Provides thought leadership on data modeling and preparation of data in databases for use in various analytics tools and to develop data pipelines to move and improve data assets.

What This Job Offers

• Job Type: Full-time
• Career Level: Principal
• Education Level: No Education Listed
• Number of Employees: 5,001-10,000 employees