Senior Software Engineer, Data Platform

Commure • Mountain View, CA

4d • $180,000 - $230,000

About The Position

Commure is hiring a Senior Software Engineer to own its data warehouse platform end-to-end. This hands-on individual contributor role covers the design, development, and operation of the platform’s CDC pipelines, streaming transport, data lake, schema governance and data contracts, query and serving layer, transformation layer, analytics platform, and related tooling. The current core stack includes Debezium for CDC, StarRocks as the MPP query and serving engine, and dbt for transformation and modeling.

The engineer will make architectural decisions, develop critical platform code, and establish data platform patterns and conventions. The role includes building low-latency, high-fidelity data pipelines; designing object-storage data lakes for batch and streaming workloads; operating and tuning query engines; developing trusted metrics and transformation practices; and implementing orchestration, CI/CD, observability, and data-quality capabilities. The engineer will also partner with Security and Compliance on PHI/PII protections and collaborate with product and analytics teams to enable reliable, self-service use of the platform.

Employees are expected to follow the organization’s information security policies, protect organizational assets, report confirmed or potential security events and risks to the information security office, and attest to these requirements upon hire and annually.

Requirements

• At least 5 years of software engineering experience, including significant experience building or operating data platforms at scale.
• Experience across the modern data stack, including CDC (Debezium or equivalent), streaming (Kafka or Redpanda), data lake formats (Iceberg, Delta Lake, or Hudi), an MPP or lakehouse query engine, and dbt.
• Fluency in SQL, schema design, query optimization, and evaluating cost and latency trade-offs on large datasets.
• Experience operating production data infrastructure, including orchestration, observability, on-call, data quality, and incident response.

Nice To Haves

• Direct production experience with Debezium, StarRocks, and dbt.
• Experience building semantic layers such as dbt Semantic Layer or Cube, or data catalogs and lineage systems such as DataHub, OpenMetadata, or Amundsen.
• Experience with HIPAA-regulated data, including PHI handling, de-identification, and access governance.
• Experience supporting AI/ML workloads, such as feature stores, training-set curation, embedding pipelines, or retrieval systems.
• Experience across multiple clouds (AWS, GCP, or Azure), infrastructure-as-code tools (Terraform or Pulumi), and Kubernetes controllers.

Responsibilities

• Own the data warehouse platform end-to-end, including CDC pipelines, data lake, query and transformation layers, and analytics-facing tooling.
• Design and operate CDC pipelines using Debezium and a streaming backbone such as Kafka or Redpanda to move operational data into the warehouse with low latency and high fidelity.
• Architect an object-storage data lake using an open table format such as Iceberg, Delta Lake, or Hudi with Parquet, supporting batch and streaming workloads and separation of storage from compute.
• Run and scale StarRocks or an adjacent MPP/lakehouse query engine, including schema design, materialized views, ingestion patterns, tuning, and cost/performance trade-offs.
• Build the dbt transformation layer, including modeling standards, tests, documentation, and a semantic layer that provides consistent metrics.
• Establish orchestration, CI/CD, observability, and data-quality tooling for reliable day-to-day platform operations.
• Partner with Security and Compliance on PHI/PII handling, access controls, lineage, and auditability to meet HIPAA and SOC 2 requirements.
• Collaborate with product and analytics teams on schema contracts, ingestion patterns, and self-service tooling.
• Follow information security policies, protect organizational assets, report potential or confirmed security events and risks, and attest to security requirements at hire and annually.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed