Data Engineer (@Remote, Chile and Colombia)
OfferUp
·
Posted:
August 17, 2023
·
Remote
About the position
We are seeking an experienced Data Engineer to build and scale OfferUp's data processing platforms and tools. This role involves designing and developing applications to process large amounts of critical information, resolving data pipeline issues, and collaborating with multiple teams to understand their data needs. The ideal candidate should have a strong background in distributed systems, proficiency in SQL and Python, and experience with open-source data infrastructure projects. Additionally, knowledge of AWS and GCP services, as well as operational tools, is a plus. A degree in Computer Science or Engineering is required.
Responsibilities
Requirements
- 3+ years of professional software development experience
- Strong ability in distributed systems for processing large scale data processing
- Ability to communicate technical information effectively to technical and non-technical audiences
- Proficiency in SQL and Python
- Experience leveraging open source data infrastructure projects, such as Airflow, Kafka, Avro, Parquet, Hadoop, Hive, HBase, Presto or Druid
- Experience building scalable data pipelines and real-time data streams
- Experience building software in AWS or a similar cloud environment
- Experience with AWS services like Kinesis, Firehose, Lambda, Sagemaker is a big plus
- Experience with GCP services like BigQuery, Cloud Functions is a big plus
- Experience with operational tools like Terraform, Datadog and Pagerduty is a big plus
- Computer Science or Engineering degree required, Masters degree preferred
- Excellent communication skills, both written and spoken (fluency in English required)