Senior Software Engineer - Query Engines & Storage
About The Position
The Plazma team at Treasure AI is one of the essential elements of our CDP solution and is part of the Core Services group, which supports customer data ingestion and availability at a rate of 70B records per day. You are expected to help the team develop the future of our Hadoop/Hive & Trino query engines and expand from there into our in-house developed storage solution. This includes maintaining technical excellence to address challenges that currently lack industry-wide solutions and delivering the roadmap together with your team. Our team consists of Big Data experts across Japan, Korea and Canada who are passionate about OSS contribution, and we take pride in the quality of service we offer.
Requirements
- 5+ years building and operating distributed systems
- Strong Java and deep understanding of algorithms, data structures, and distributed systems fundamentals
- Solid understanding of cloud architecture and services in public clouds like AWS, GCP, or Microsoft Azure
- Strong capability in implementing new and improved data solutions for multi-tenant environments
- Experience in developing use cases, functional specs, design specs, etc.
- Experience working with distributed, scalable Big Data stores or NoSQL, including HDFS, S3, Cassandra, Big Table, etc.
- Strong analytical and communication skills; able to influence across Product, SRE, and Support
Nice To Haves
- Understanding of the capabilities of Hadoop/Hive or Trino
- Proven experience operating production query engines on a petabyte scale
- Microservices architecture, data integration patterns, and extending OSS
- Infra-as-Code, SRE practices, and advanced observability
- UDF development and familiarity with data visualization ecosystems
- Security and privacy-by-design expertise
- Experience with storage patterns and optimizations for massive parallel processing
Responsibilities
- Design and develop Hadoop/Hive & Trino solutions, providing technical expertise for modern data architecture assessment and use case development
- Establish engineering standards for design, development, tuning, deployment, and maintenance of advanced data access frameworks and distributed systems
- Collaborate with your team to define product roadmaps based on operational needs and customer-requested features while mentoring and training new team members
- Own version and release management, including baseline evaluation, patch backporting, and deployment of customer-facing features
- Coordinate with Support and Product teams on release cycles and feature delivery
- Contribute to Hadoop/Hive & Trino OSS through bug fixes, new features, and technical documentation
- Partner with SRE to automate cluster operations, reducing operational overhead through automated lifecycle management and load balancing workflows
- Design and implement observability solutions, including health metrics, capacity planning tools, and automated failure detection and recovery systems
- Provide expert customer support, including on-call responsibilities, escalation handling, and in-depth troubleshooting of performance and defect issues
- Develop custom technical solutions, including user-defined functions (UDFs) and specialized tooling for Hadoop/Hive & Trino
Benefits
- Competitive compensation packages
- Restricted Stock Units (RSU)
- Paid vacation and sick time
- Paid volunteer and mental health days
- Up to 26 weeks paid parental leave including a post-partum night nurse
- 16 Company holidays (includes 2 floating holidays)
- RRSP with 6% company match
- Employer provided Supplemental medical, dental, disability & life coverage
- Comprehensive support and access to care for everyone, everywhere through Carrot - our global reproductive health and family-building benefit
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
