Data Team Lead

Edgestream • Princeton, NJ

1d

About The Position

Edgestream is seeking an experienced, hands-on data leader to join our engineering team. This is a high-impact role responsible for shaping the architecture and evolution of the firm’s data platform across the full lifecycle of our systematic trading and quantitative research systems.

The position offers the opportunity to play a central role in designing and scaling the data infrastructure throughout the firm. The successful candidate will combine architectural leadership with hands-on engineering while working closely with researchers, engineers, and trading teams across the firm.

Requirements

• Bachelor’s or Master’s degree in computer science, engineering, mathematics, physics, or a related quantitative discipline.
• At least 7 years of experience in financial data management, data strategy, and leadership roles.
• Demonstrated success executing independently in a high-performance and rapidly evolving environment.
• Experience integrating data from financial data vendors and exchange feeds, along with a strong understanding of corporate actions, instrument symbology, and security master design.
• Strong proficiency with modern database systems, including open-source technologies such as PostgreSQL and cloud-based platforms such as Snowflake, Databricks, or BigQuery.
• Strong proficiency and hands-on experience with Python, including experience with libraries such as Pandas, Polars, and NumPy.
• Exceptional attention to detail along with strong organizational and communication skills.
• Proven ability to leverage modern AI/ML tooling effectively to solve complex problems and enhance data workflows.

Nice To Haves

• Deep familiarity with financial market data structures, including equities, futures, and FX datasets, particularly in the context of building historical backfill and replay pipelines for research and backtesting.
• Experience working with NoSQL and vector databases to store, index, and query large-scale semi-structured and unstructured datasets.
• Experience designing and operating large-scale data lake or lakehouse architectures for financial or time-series data, including modern table formats such as Apache Iceberg or Delta Lake.
• Experience building columnar data architectures using technologies such as Parquet or Apache Arrow.
• Strong understanding of partitioning strategies, metadata catalogs, and schema evolution for large-scale datasets.
• Experience building distributed data processing pipelines using frameworks such as Apache Spark.
• Solid understanding of parallel computing, task orchestration, and distributed query execution.
• Experience optimizing large-scale ETL workloads for throughput, latency, and operational efficiency.

Responsibilities

• Lead and develop the firm’s data engineering team, fostering a results-oriented culture that balances immediate business needs with long-term data strategy.
• Take ownership of critical production data pipelines, maintaining and enhancing them to ensure reliability, performance, and scalability.
• Design and implement the firm’s next-generation data platform supporting large-scale market data and heterogeneous financial datasets used in research and trading.
• Optimize data workflows and operational processes, leveraging modern AI and data technologies to improve efficiency and engineering productivity.
• Collaborate closely with trading operations, quantitative researchers, and business teams to assess needs, prioritize initiatives, and plan data platform development.

Benefits

• Competitive salary, bonus, and incentive compensation tied to overall firm performance.
• High ownership and visibility within a close-knit team of experienced engineers and seasoned researchers.
• Access to extensive technical and data resources developed over decades of systematic trading.
• Comprehensive benefits package including medical and dental coverage, 401(k), HRA, FSA, life insurance, catered lunch, and an onsite gym.
• For qualified employees, the opportunity to invest in Edgestream-managed funds.
• A collaborative and intellectually rigorous environment with strong mentorship and long-term growth opportunities.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level