Data engineer

abra • Wheaton, IL

5d

About The Position

abra professional services is seeking a talented Data Engineer! We are looking for a Data Engineer to join our team and work on cutting-edge AI projects. In this role, you will be responsible for ingesting large volumes of new data, as well as deeply understanding and analyzing it in close collaboration with our Data Scientists. You will design and develop critical, diverse, and large-scale data pipelines across both Cloud and On-Premises environments.

Requirements

• B.Sc. in Computer Science, Engineering, Mathematics, or Statistics
• 3+ years of hands-on experience as a Data Engineer
• 3+ years of experience with Python and Object-Oriented Programming (OOP)
• Proven practical experience with Spark for large-scale data processing
• Deep understanding of designing, developing, and optimizing complex high-volume data systems
• Familiarity with data formats and optimization/partitioning techniques (Parquet, Avro, HDF5, Delta Lake)
• Solid conceptual and practical understanding of Docker, Linux, CI/CD tools, and Kubernetes
• Experience with data pipeline orchestration tools such as Airflow or Kubeflow
• Understanding of core Machine Learning concepts and workflows

Responsibilities

• Ingesting large volumes of new data
• Deeply understanding and analyzing data in close collaboration with Data Scientists
• Designing and developing critical, diverse, and large-scale data pipelines across both Cloud and On-Premises environments

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level