Data Infrastructure Engineer (Java & Rust)
About The Position
MWDN is hiring a Data Infrastructure Engineer for a technology startup building an AI-powered platform for autonomous data lakehouse management and optimization. The platform automates data maintenance, improves query performance, and reduces infrastructure costs across large-scale data environments using Apache Iceberg. The team works on high-performance data systems, distributed computing, Rust-based optimization, and AI integration. The role focuses on building and maintaining high-performance data lakehouse infrastructure and reliable Apache Iceberg maintenance workflows, including compaction, snapshot expiry, manifest rewriting, and orphan file cleanup. Data integrity and correctness are central to the work. The position also involves contributing to a Rust-based, multi-engine SQL query router, maintaining connectors, reviewing community contributions, and helping shape the product roadmap. The engineer will have significant ownership, run their work in production, and handle on-call and debugging in customers’ environments.
Requirements
- At least 5 years of software development experience in Java.
- Strong Rust development experience.
- Experience with TypeScript.
- Production experience with data infrastructure and maintaining production systems.
- Working knowledge of Apache Iceberg and Parquet.
- Solid experience with PostgreSQL.
- Experience with Kubernetes.
- Understanding of data maintenance operations and data integrity.
- Ability to work independently and take ownership of technical solutions.
- Strong communication and collaboration skills, including code reviews and open-source contributions.
Nice To Haves
- Experience with Apache Spark or DataFusion.
- Experience with query engines such as Trino.
- Experience with SQL routing, query proxying, or multi-engine query systems.
Responsibilities
- Build and maintain high-performance data lakehouse infrastructure.
- Develop reliable Apache Iceberg maintenance workflows for compaction, snapshot expiry, manifest rewriting, and orphan file cleanup.
- Design and ship services that turn table health signals into safe, correct maintenance operations.
- Ensure commits to customer tables are verifiably correct, including under concurrent writers, retries, and partial failures.
- Work on a production-grade compaction engine and its supporting systems.
- Maintain QueryFlux by triaging issues, reviewing pull requests, building engine connectors, and preparing releases.
- Run developed systems in production, including on-call work and debugging in customers’ environments.
- Contribute to open-source development and help shape the product roadmap.
Benefits
- Flexible working hours.
- 29 days of PTO (18 working days per year plus all national holidays).
- 10 paid recovery days.
- Full financial and legal support for independent contractors.
- Free English classes with native speakers or Ukrainian teachers.
- Dedicated HR support.
- Professional growth opportunities and team-building events.
- Career support to help find another project if the current project is not a good fit.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
