About the position
We are seeking a Senior Data Engineer to join our team at Tech Holding. The ideal candidate will have experience with big data tools such as Hadoop, Spark, Kafka, and Airflow, as well as relational SQL and NoSQL databases. They should also be proficient in either Python, Java, or Scala. The Data Engineer will be responsible for expanding and optimizing our data and data pipeline architecture, supporting our software developers, data analysts, and data scientists on data initiatives. This is an exciting opportunity to work in a collaborative environment with some of the industry's brightest minds.
Responsibilities
- Expand and optimize data and data pipeline architecture
- Support software developers, data analysts, and data scientists on data initiatives
- Be self-directed and comfortable supporting the data needs of multiple teams, systems, and products
- Optimize or redesign the company's data architecture to support next generation products and data initiatives
Requirements
- Experience with big data tools such as Hadoop, Spark, Kafka, Airflow, etc.
- Experience with relational SQL and NoSQL databases.
- Experience with either Python, Java, or Scala.
- Nice to have experience using hosted toolsets like AWS (ECS, Lambda, EKS, EMR, Glue, S3, Data lake, Glacier), GCP (Dataproc, Pub/Sub, Batches, Bigtable, Bigquery), Azure (Azure Datawarehouse, SSMS, SSIS, SQL Server).
- Experienced with PL/SQL.