Azure Databricks Engineer- 3+ Months- USA- ASAP- Remote

Global Enterprise Partners
425dRemote

About The Position

Global Enterprise Partners is seeking an experienced Azure Data Engineer for a contract project with a global Agri science client. The role focuses on designing, building, and maintaining data pipelines using various Azure technologies and best practices in DataOps and MLOps to enhance system performance.

Requirements

  • Proven experience in data engineering, building and maintaining data pipelines, and ETL processes.
  • Proven experience building and maintaining data products within Databricks.
  • Hands-on experience with Databricks and its ecosystem.
  • Proficient in Apache Spark, including Spark SQL, Spark Streaming, and Spark MLlib.
  • Skilled in programming languages such as Python, Scala, SQL, and Java.
  • Knowledge of relational and NoSQL databases, data modeling, and query optimization.

Nice To Haves

  • Databricks Certifications (beneficial but not required).
  • Cloud Certifications such as Azure or similar (advantageous).

Responsibilities

  • Design, build, and maintain data pipelines using Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark.
  • Implement DataOps and MLOps best practices to optimize data system performance.
  • Enhance data pipelines for fault tolerance and performance improvement.
  • Drive process improvement through tracking, training, and sharing knowledge.
  • Mentor junior Azure Data Engineers.

Benefits

  • Remote work options available.
  • Flexible working hours.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service