Senior Data Platform Engineer (Remote)

Crystal Intelligence • Webster, MA

1d • Remote

About The Position

We are looking for a talented Senior Data Platform Engineer to join our Data Engineering team, to participate in the development and maintenance of data pipelines for blockchain data processing. This is a remote role, and we are flexible with considering applications from anywhere in Europe.

More details: crystalblockchain.com

Requirements

• 8+ years of experience in software engineering, developing backend services/APIs or data pipelines
• Strong knowledge and experience with Python
• Advanced knowledge of SQL - ability to write, understand and debug complex queries
• Strong database architecture principles
• Strong experience with data lakes, data warehouses, relational and analytical databases
• POSIX/Unix/Linux ecosystem knowledge
• Blockchain tech knowledge or willingness to learn
• Experienced in Unit Testing principles
• Experience with Docker containers and proven ability to migrate existing services
• Independent and autonomous way of working
• Team-oriented work and good communication skills are an asset

Nice To Haves

• Practical experience in big data and frameworks – Kafka, Spark, Dask, Flink and Data Lakes
• Experience with Kubernetes and Infrastructure as Code – Terraform and Ansible
• Experience with API frameworks such as Flask or FastAPI
• Experience with distributed systems
• Experience with opensource solutions
• Experience with Java or willingness to learn

Responsibilities

• Active participation in development and maintenance of our data pipelines and backend services
• Integration of blockchains, Automated Market Maker (AMM) protocols, and bridges within Crystal's platform
• Integrate new technologies into our processes and tools
• End-to-end feature designing and implementation
• Code, debug, test and deliver features and improvements in a continuous manner
• Provide code review, assistance, and feedback for other team members

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed