Software Engineer – Query Engines

Palantir Technologies • New York, NY

4d • Hybrid

About The Position

A World-Changing Company Palantir builds the world’s leading software for data-driven decisions and operations. By bringing the right data to the people who need it, our platforms empower our partners to develop lifesaving drugs, forecast supply chain disruptions, locate missing children, and more. The Role We are a software engineering team applying open-source data technologies to some of the world’s hardest and most important problems. We build the data processing infrastructure that underpins Palantir Foundry, supporting applications that help hospitals care for more patients, help clinical teams coordinate timely diagnoses, and keep essential supplies moving through global disruption. You will work deep inside the systems that make this possible: how computations are represented, how query plans are optimized, how operators execute, and how data is read and written efficiently. We build on and extend Apache Spark, Apache DataFusion, and Apache Iceberg, bringing advances in open-source engines and table formats into the demanding environments our customers operate in. Our work serves many products and workloads across Foundry, including no-code pipelines, interactive analysis, and the processing that keeps the Ontology up to date. You will own improvements from design through production, whether that means developing a planning rule, extending a native execution engine, or improving the way large tables are scanned and updated. Correctness, compatibility, and predictable performance are central to everything we build. A change in a shared engine can benefit applications across the platform and the people who rely on them. Join us if you want to advance the capabilities of modern data systems and apply that work to consequential problems.

Requirements

• 4+ years of professional software engineering experience building and operating production systems.
• Engineering background in Computer Science, Mathematics, Software Engineering, Physics, or a similar field, or equivalent practical experience.
• Strong coding skills with demonstrated proficiency in one or more languages such as Java, Rust, Scala, or C++.
• Experience developing database engines, distributed data processing systems, storage systems, or comparable infrastructure, with depth in areas such as query planning, execution, or performance optimization.
• Strong foundations in algorithms, data structures, and concurrency, with experience diagnosing correctness and performance problems in complex systems.
• Strong written and verbal communication skills and the ability to work effectively across teams, incorporate feedback, and hold a high bar for quality.

Nice To Haves

• Ownership mindset and a high bar for correctness. Our systems support decisions and operations that customers depend on.
• Curiosity about how data systems work, from query optimizers and execution operators to table formats and distributed processing.
• Strong debugging skills and motivation to follow a problem across languages, services, and layers of the stack.
• A practical approach to performance, grounded in profiling, representative workloads, and measurable improvements.
• Interest in applying deep systems engineering to real-world problems, with empathy for the people who use and depend on our software.
• Experience building or extending systems such as Spark, DataFusion, Iceberg, or comparable technologies, and an interest in learning across the stack.
• Ability to collaborate across teams and work effectively with the open-source projects we build on.
• Experience contributing to open-source projects is valued, but not required.

Responsibilities

• Designing and implementing query planning and optimization capabilities that turn complex computations into efficient execution plans
• Extending execution engines with new capabilities and improving query operators, parallelism, memory management, and data movement
• Developing Foundry’s Iceberg catalog and engine integrations, including table metadata, transactions, and efficient reads and writes
• Building shared transformation semantics and execution interfaces for workloads across Foundry’s products and platform services
• Improving incremental processing so pipelines can reuse previous results and process new data efficiently while preserving correctness
• Evaluating and integrating advances in open-source data systems, validating their behavior and performance against real-world workloads
• Investigating correctness and performance issues across planning, execution, and storage, and building tests and benchmarks that prevent regressions
• Working with product teams and customers to translate operational needs into engine capabilities that integrate with Foundry’s security, data management, and build infrastructure.

Benefits

• Employees (and their eligible dependents) can enroll in medical, dental, and vision insurance as well as voluntary life insurance
• Employees are automatically covered by Palantir’s basic life, AD&D and disability insurance
• Commuter benefits
• Relocation assistance
• Take what you need paid time off, not accrual based
• 2 weeks paid time off built into the end of each year (subject to team and business needs)
• 10 paid holidays throughout the calendar year
• Supportive leave of absence program including time off for military service and medical events
• Paid leave for new parents and subsidized back-up care for all parents
• Fertility and family building benefits including but not limited to adoption, surrogacy, and preservation
• Stipend to help with expenses that come with a new child
• Employees can enroll in Palantir’s 401k plan

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed