Principal Data Engineer

Sayari

1d • $200,000 - $220,000

About The Position

We are looking for a Principal Data Engineer to join our Data Resolution team and serve as a technical anchor for our most complex data challenges. In this role, you will be a "player-coach," spending the majority of your time (70%) hands-on with Spark and graph data logic while dedicating the remainder of your time to system architecture, design planning, and technical mentorship. You will be instrumental in evolving our graph build pipelines, optimizing our cloud footprint, and overseeing the long-term planning and execution of major data pipeline re-architectures. This is a high-impact role where your work directly powers the data products used by global systems defenders.

Requirements

• 8+ years of experience in the big data space, with a proven track record of implementing large-scale features and leading process redesigns.
• Expert-level mastery of Apache Spark for large-scale data processing.
• Strong experience with orchestration tools (Airflow) and cloud computing environments.
• Hands-on experience architecting and managing data flows into databases such as Elasticsearch, Memgraph, and Cassandra.
• Demonstrated ability in system architecture, including Infrastructure as Code (IaC) and schema design.
• A "builder" mindset with experience evolving and improving existing architectures to meet new scale requirements.

Nice To Haves

• Experience working specifically with graph data or graph databases.
• Prior experience with entity resolution or identity resolution systems.
• Experience evaluating and selecting modern analytical database architectures.

Responsibilities

• Design and implement complex Spark data logic, focusing on performance optimization, data volume tuning, and robust execution.
• Own the architectural design of graph build pipelines, ensuring they are scalable, automated, and highly resilient.
• Plan and oversee the strategic re-architecture of data pipelines to meet evolving business needs and scale.
• Optimize infrastructure-as-code and schema designs to reduce cloud costs and improve pipeline latency.
• Act as a technical consultant for the team, fostering a collaborative and engineer-led approach to design decisions.
• Support the development of the engineering team through code reviews, design docs, and architectural best practices.
• Ensure the accuracy of mission-critical data outputs.

Benefits

• 100% fully paid medical, vision, and dental for employees and their dependents
• Generous time off; we observe all US federal holidays, close our office for a winter break (12/24-12/31), in addition to granting 18 PTO days and 10 sick days
• Outstanding compensation package; competitive commissions for revenue roles and quarterly bonuses for non-revenue positions
• A strong commitment to diversity, equity, and inclusion
• Eligibility to participate in additional benefits such as 401k match up to 5%, 100% paid life insurance (up to $100,000 coverage),, and parental leave
• A collaborative and positive culture - your team will be as smart and driven as you
• Limitless growth and learning opportunities

What This Job Offers

• Job Type: Full-time
• Career Level: Principal
• Education Level: No Education Listed
• Number of Employees: 51-100 employees