Data Engineer, Data & Analytics

Louis Dreyfus CompanyWilton, CT
11h

About The Position

LDC is seeking a talented Data Engineer to join our expanding team of Data Analytics and AI. In this role, you'll architect and implement innovative data solutions that directly impact business decision-making and operational efficiency. As a data engineer at LDC, you'll work at the forefront of agricultural technology, building scalable data pipelines and AI-powered analytics solutions. You'll collaborate with diverse datasets—from satellite imagery and weather forecasts to market data and proprietary trading information—transforming raw data into actionable intelligence that powers our business.

Requirements

  • 2+ years of experience in data engineering roles with focus on data modeling, pipeline development, ETL/ELT, and analytics platform management
  • Expert-level proficiency in SQL for complex queries, optimization, and performance tuning
  • 1+ years of hands-on experience with Python for data engineering, including libraries such as Pandas, NumPy, PySpark, and data visualization tools (Plotly, Matplotlib)
  • Proficiency with modern cloud data platforms (Azure preferred, AWS or GCP acceptable)
  • Experience with data orchestration tools (Azure Data Factory preferred, Airflow, Prefect, Dagster)
  • Understanding of DataOps, CI/CD pipelines, version control (Git), and infrastructure as code
  • Bachelor's or, Master's degree in Computer Science, Data Engineering, Computer/Systems Engineering, Data Science, Statistics, Mathematics, or related quantitative field. Candidates with equivalent professional experience and demonstrated technical expertise will be considered.

Nice To Haves

  • Experience with distributed computing frameworks (Databricks, Apache Spark)
  • Understanding of commodities trading, supply chain analytics, or agricultural industry domains

Responsibilities

  • Design, build, and maintain scalable data pipelines and ETL/ELT workflows using modern cloud-native architectures
  • Design and implement robust software solutions in Python, focusing on scalability, performance, and reliability.
  • Schedule and automate workflows, enhancing operational efficiency and accuracy.
  • Collaborate in the development and maintenance of cloud-based infrastructure, applying best practices in DevOps to ensure high data availability and scalability.
  • Work closely with data scientists, quantitative researchers, and trading teams to understand their data needs, providing technical solutions that enable effective data analysis and strategy implementation.
  • Ensure code quality and maintainability by implementing strong CI/CD practices, code versioning, automated tests, and conducting thorough peer-reviews.
  • Stay current with emerging trends and advancements in software development, data engineering, and cloud technologies, integrating new tools and techniques where beneficial.
  • Expertise in handling and optimizing relational databases to support analytical applications
  • Ensure data quality, governance, and compliance through automated testing and monitoring frameworks
  • Design and implement dimensional data models, star schemas, and semantic layers optimized for analytics and reporting
  • Create and maintain data models and data transformation logic using SQL and Python
  • Develop automated, high-quality indicators and KPIs from diverse data sources
  • Perform exploratory data analysis to uncover patterns and support business intelligence initiatives
  • Collaborate with data scientists to productionize machine learning models and AI solutions

Benefits

  • Comprehensive benefits program including medical, dental and vision care coverage, flexible spending account plans, employee assistance program, life insurance and disability coverage
  • 401k with Company Match
  • Family Friendly Benefits including childbirth and parental leave, fertility and family building benefits
  • Paid Time Off (PTO) and Paid Holidays
  • Flexible work available (not applicable to all roles)
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service