Data Engineer, Data & Analytics

Louis Dreyfus Company•Wilton, CT

11h

About The Position

LDC is seeking a talented Data Engineer to join our expanding team of Data Analytics and AI. In this role, you'll architect and implement innovative data solutions that directly impact business decision-making and operational efficiency. As a data engineer at LDC, you'll work at the forefront of agricultural technology, building scalable data pipelines and AI-powered analytics solutions. You'll collaborate with diverse datasets—from satellite imagery and weather forecasts to market data and proprietary trading information—transforming raw data into actionable intelligence that powers our business.

Requirements

2+ years of experience in data engineering roles with focus on data modeling, pipeline development, ETL/ELT, and analytics platform management
Expert-level proficiency in SQL for complex queries, optimization, and performance tuning
1+ years of hands-on experience with Python for data engineering, including libraries such as Pandas, NumPy, PySpark, and data visualization tools (Plotly, Matplotlib)
Proficiency with modern cloud data platforms (Azure preferred, AWS or GCP acceptable)
Experience with data orchestration tools (Azure Data Factory preferred, Airflow, Prefect, Dagster)
Understanding of DataOps, CI/CD pipelines, version control (Git), and infrastructure as code
Bachelor's or, Master's degree in Computer Science, Data Engineering, Computer/Systems Engineering, Data Science, Statistics, Mathematics, or related quantitative field. Candidates with equivalent professional experience and demonstrated technical expertise will be considered.

Nice To Haves

Experience with distributed computing frameworks (Databricks, Apache Spark)
Understanding of commodities trading, supply chain analytics, or agricultural industry domains

Responsibilities

Design, build, and maintain scalable data pipelines and ETL/ELT workflows using modern cloud-native architectures
Design and implement robust software solutions in Python, focusing on scalability, performance, and reliability.
Schedule and automate workflows, enhancing operational efficiency and accuracy.
Collaborate in the development and maintenance of cloud-based infrastructure, applying best practices in DevOps to ensure high data availability and scalability.
Work closely with data scientists, quantitative researchers, and trading teams to understand their data needs, providing technical solutions that enable effective data analysis and strategy implementation.
Ensure code quality and maintainability by implementing strong CI/CD practices, code versioning, automated tests, and conducting thorough peer-reviews.
Stay current with emerging trends and advancements in software development, data engineering, and cloud technologies, integrating new tools and techniques where beneficial.
Expertise in handling and optimizing relational databases to support analytical applications
Ensure data quality, governance, and compliance through automated testing and monitoring frameworks
Design and implement dimensional data models, star schemas, and semantic layers optimized for analytics and reporting
Create and maintain data models and data transformation logic using SQL and Python
Develop automated, high-quality indicators and KPIs from diverse data sources
Perform exploratory data analysis to uncover patterns and support business intelligence initiatives
Collaborate with data scientists to productionize machine learning models and AI solutions

Benefits

Comprehensive benefits program including medical, dental and vision care coverage, flexible spending account plans, employee assistance program, life insurance and disability coverage
401k with Company Match
Family Friendly Benefits including childbirth and parental leave, fertility and family building benefits
Paid Time Off (PTO) and Paid Holidays
Flexible work available (not applicable to all roles)

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume