Data Engineer

Rootshell Enterprise Technologies•Portland, OR

3d•Onsite

About The Position

Rootshell Inc. is seeking a Big Data Engineer for a long-term role in Portland, OR. The ideal candidate will have strong experience in Scala or Python, experience building domain-driven microservices, and expertise in data modeling within the Hadoop ecosystem and various data stores.

Requirements

Strong experience in Scala or Python.
Experience building domain-driven microservices.
Experience with data modeling in different data stores and the Hadoop ecosystem.
Experience working with data stores such as Snowflake, DynamoDB, etc.
Experience working with Big Data frameworks such as Spark, Hive, Nifi, Spark-streaming, Kinesis, Kafka, etc.
Experience with performance and scalability tuning.
Experience working with schema evolution, serialization, and validation with file formats such as JSON, Parquet, Avro, etc.
Experience working in the AWS environment, specifically S3 and EMR.
Experience working with Airflow.
Familiarity with practices such as CI/CD and Automated testing.
Agile/Scrum Application development experience.

Nice To Haves

An interest in artificial intelligence and machine learning.

Responsibilities

Build domain-driven microservices.
Perform data modeling in different data stores and the Hadoop ecosystem.
Work with data stores such as Snowflake, DynamoDB, etc.
Utilize Big Data frameworks such as Spark, Hive, Nifi, Spark-streaming, Kinesis, Kafka, etc.
Focus on performance and scalability tuning.
Manage schema evolution, serialization, and validation with file formats like JSON, Parquet, Avro, etc.
Work within the AWS environment, specifically S3 and EMR.
Utilize Airflow.
Apply CI/CD and Automated testing practices.
Engage in Agile/Scrum application development.
Develop applications with an interest in artificial intelligence and machine learning.