Senior Query Optimizer Software Engineer

We are seeking a highly motivated Senior Query Optimizer Software Engineer to join our team at Voltron Data. In this role, you will have the opportunity to contribute to the growth and support of the Voltron Data and Apache Arrow ecosystems. Your main responsibility will be to collaborate with our development teams in building and maintaining a SQL parser and query optimizer for both single node and distributed query execution engines. As a part of our team, you will play a crucial role in driving innovation in data processing and leveraging the speed and efficiency of modern hardware.

Build and maintain a SQL parser and query optimizer for large scale single node and distributed query execution engines

Learn about the Apache Arrow compute primitives, compute intermediate representation, compute engine, and other foundational components

Familiarize yourself with the different partners for compute kernels and the query execution engine on Apache Arrow

Embrace the Apache development process

Benchmark queries and explore the effects of different query optimization techniques using the query optimizer

Make changes and improvements to the existing query optimization rules and how it creates physical execution plans for the execution engines under development

Add new query optimization rules and techniques

• Highly motivated Senior Query Optimizer Software Engineer
• Experience in building and maintaining a SQL parser and query optimizer
• Familiarity with large scale single node and distributed query execution engines
• Knowledge of Apache Arrow compute primitives, compute intermediate representation, compute engine, and other foundational components
• Understanding of the different partners for compute kernels and the query execution engine on Apache Arrow
• Proficiency in the Apache development process
• Ability to benchmark queries and explore the effects of different query optimization techniques
• Experience in making changes and improvements to query optimization rules and physical execution plans
• Knowledge of decision making in cost-based optimization based on metadata availability
• Familiarity with integrating non-SQL operations to the optimization framework
• Ability to identify and address performance bottlenecks in customer queries
• Proficiency in proposing and implementing improvements to the query parsing and optimization framework
• Understanding of stateful inter-query query engine context to optimize compute stages across similar queries
• Previous experience with open source query optimization frameworks like Apache Calcite or Apache Spark

• Work from Anywhere - Payroll and Benefits in 150+ Countries
• Unlimited PTO
• Medical, Dental, and Vision
• Retirement [USA Only]
• Home Office Budget
• Continuing Education Budget