Technical Lead, Data Engineering

Distributed Spectrum•New York, NY
•$160,000 - $200,000

About The Position

Distributed Spectrum (DS) builds systems for radio spectrum intelligence by collecting radio data globally, training neural networks to interpret it, and running those models on small chips. The organization has developed its own technical stack, including embedding model architectures and custom GPU kernels, and emphasizes ownership, collaboration, technical rigor, business value, and real-world impact. The Technical Lead, Data Engineering will design and build the data platform for continuous, high-rate streams collected from sensors around the globe. The platform will serve researchers training models, production systems running inference, and agents retrieving context in real time. The role owns architecture from ingestion through storage, cataloging, vector search, and access, with the platform designed specifically for AI/ML workloads as well as analytics.

Requirements

  • 4–6+ years of software or data engineering experience, including several years designing and operating large-scale data platforms in production.
  • Deep experience with lakehouse architectures and technologies such as Apache Iceberg, Delta Lake, or Hudi; Parquet; and Spark, Flink, Trino, DuckDB, or similar engines.
  • Hands-on experience with vector databases and embedding retrieval, including indexing trade-offs and scaling.
  • Strong experience with AWS or another major cloud provider, including object storage, managed data services, compute, and cost optimization at scale.
  • Fluency in Python and SQL.
  • Experience with orchestration tools such as Airflow, Dagster, Prefect, or Step Functions.
  • Demonstrated experience designing data architectures specifically for ML/AI workloads, such as training data pipelines, feature stores, dataset versioning, or retrieval systems.
  • Strong grasp of data modeling, consistency, and the trade-offs between batch and streaming.
  • Must currently hold or be eligible to obtain and maintain a U.S. government security clearance.
  • For ITAR compliance, must be a U.S. citizen, lawful permanent resident of the U.S., protected individual as defined by 8 U.S.C. 1324b(a)(3), or eligible to obtain required authorizations from the U.S. Department of State.

Nice To Haves

  • Experience with high-volume streaming ingestion technologies such as Kafka, Kinesis, or Pulsar.
  • Experience with time-series, geospatial, or signal/sensor data.
  • Familiarity with data governance and security requirements in regulated environments.
  • Experience with Rust, Go, or C++ for performance-critical data paths.

Responsibilities

  • Architect and build the data lakehouse, including ingestion pipelines, open table formats, partitioning and compaction strategies, cataloging, and governance.
  • Design and operate vector database infrastructure for embedding storage, similarity search, and retrieval at scale; select, tune, and evolve systems for the workloads.
  • Build large-scale data management systems for lifecycle and retention, lineage, dataset versioning for reproducible training, quality monitoring, and cost management across petabyte-class storage.
  • Design data platform capabilities for ML use cases, including feature and embedding pipelines, training-set assembly, evaluation datasets, and low-latency retrieval for agents.
  • Establish schema and data-contract standards across teams and build self-service tooling for researchers and engineers.
  • Own production data-pipeline reliability and performance, including observability and failure handling.
  • Mentor engineers and lead technical design across the data domain.

Benefits

  • Above-market salary, equity, and benefits package.
  • Early Series A equity.
  • Excellent health, dental, and vision coverage.
  • 401(k) match up to 4% of salary.
  • Flexible PTO.
  • Daily office lunches in NYC.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service