Senior Data Engineer

Drata • San Francisco, CA

2d • Hybrid

About The Position

Drata is seeking a Senior Data Engineer with a strong technical understanding to join our data platform team. The ideal candidate will spearhead the development of an advanced analytics program, collaborating closely with key stakeholders to drive the organization's continuous growth. As a crucial member of our dynamic data department, consisting of Data Engineers, Analytics Engineers, Data Analysts, and Data Scientists, you will tackle the challenges presented by our unique data pipeline streaming from thousands of MySQL databases to our data warehouse, focusing on scalability, reliability, and performance optimization. We ensure all teams at Drata can easily self-serve the data and reports they need to drive their projects and make decisions. If you’re excited to work on a fast-moving team using cutting-edge technologies to collect, store, transform, analyze, and model data, we want to meet you!

Requirements

• 8+ years of advanced SQL development experience coupled with robust Python or Java programming capabilities.
• 4+ years of hands-on experience with data warehousing technologies (Snowflake, BigQuery, Redshift).
• 3+ years of experience working with streaming using Spark or Flink or Kafka or NoSQL or relevant technologies
• Extensive experience building and optimizing large-scale ETL pipelines, data modeling and schema design. Including CDC, structured and unstructured data.
• A fearless attitude towards technological change and a drive to thrive in fast-paced, dynamic settings.
• You have strong dedication to code quality, automation and operational excellence: CI/CD pipelines, unit/integration tests.
• Demonstrated experience in building working in AWS, web services and/or working with ML pipelines and LLM models.
• Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, Operations Research, Data Science or related field.
• Solid understanding of data security and compliance requirements.
• Effective communication skills, conveying complex technical concepts to non-technical stakeholders.
• Ability to thrive in a fast-paced, high-growth startup environment with a balance of autonomy and collaboration.

Responsibilities

• Develop and maintain robust data models and schema designs.
• Design and develop complex data pipelines for efficient and scalable data processing.
• Optimize data infrastructure and enhance overall system performance.
• Advanced programming skills (Python, Java, or equivalent) for data processing and analysis tasks.
• Implement and optimize algorithms for data transformation, cleansing, and enrichment.
• Drive the adoption of best practices in data governance, security, and management.
• Collaborate with Software Engineers to integrate data analytics solutions into production systems.
• Apply machine learning techniques to extract insights and patterns from large datasets.
• Collaborate with cross-functional teams to understand business requirements and provide data-driven solutions.
• Formulate the right metrics and definitions of success to drive quality, efficiency, cost, timeliness and understanding the source data.
• Develop and maintain documentation for data processes, pipelines, and models.
• Engage with LLM models, showcasing your capacity to work with cutting-edge AI technologies.
• Continuously stay up-to-date on industry trends and advancements in data engineering and analytics.

Benefits

• Shared Success : We provide stock equity to ensure that as the company grows, you share directly in that success. Equity gives every employee a sense of ownership and the opportunity to celebrate our wins together—because your contributions don’t just support our progress; they help drive our collective success.
• Health & Wellness: Up to 100% employer-paid premiums for medical, dental, and vision coverage for employees and their dependents , along with comprehensive wellness benefits and healthcare concierge services designed to support your needs beyond traditional insurance.
• Financial Well-being: A comprehensive suite of financial benefits, including a 401(k) plan , company-paid life and disability insurance , tax-advantaged spending accounts , and a range of discounted voluntary offerings to help you customize and strengthen your overall financial position.
• Family Support: Up to 16 weeks of paid parental leave (after six months of employment), along with a robust suite of family-support resources. Employees also receive access to Kindbody fertility and family-building benefits and dedicated leave specialists who help guide you through the entire process.
• Growth & Development: Generous annual stipends for both professional and personal development, empowering you to invest in your continued growth. You’ll also have access to a wide range of internal learning opportunities, ensuring you can build new skills, deepen your expertise, and advance your career with confidence.
• Time Off & Flexibility: We believe that to do your best work, you should get the time you need for rest, rejuvenation and recovery. Drata offers a flexible vacation policy, paid holidays, and other perks to recharge.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 501-1,000 employees