Core Data Engineer

Flow Traders • New York, NY

2h • $165,000 - $210,000

About The Position

Flow Traders is seeking a Core Data Engineer to own the end-to-end lifecycle of fundamental data products, including its Security Master, reconciled ETF compositions, high-resolution historical market data, and records of trades, orders, quotes, and inquiries. The role focuses on producing high-quality, reliable data that reduces operational complexity for stakeholders and supports the growth of quantitative trading strategies.

The engineer will design and execute blueprints for these products using the company’s Data Platform, building and monitoring automated pipelines. The role also requires developing deep expertise in the data sets, improving how existing data is used, exploring new data sources, and collaborating across the organization to design data-aware systems, streamline workflows, and help stakeholders maximize data value.

As the architect and guardian of important firm data, the Core Data Engineer is accountable for delivering timely, high-quality data products that support the firm’s strategic growth. The position works closely with quants and data users, supports critical pipelines across regions and digital asset markets that operate continuously, and is part of a team providing support across time zones.

The total compensation includes a base salary range of $165,000 to $210,000, plus annual discretionary variable remuneration based on company, group, and individual performance and contribution.

Requirements

• Experience in analytics or data engineering, ideally at a startup or scale-up going through a growth phase.
• Strong data modelling and data quality practices, including tests, contracts, lineage, and production observability.
• Strong proficiency in Python; familiarity with another statically typed language is ideal.
• Working proficiency with SQL, relational databases, and version control systems.
• Demonstrated ability to work with large datasets and familiarity with big data solutions.
• Experience owning something in production, rather than only building it.
• Enjoyment of working directly with the people who use the data.
• Strong interpersonal and communication skills, including effective collaboration with technical and non-technical stakeholders.
• Ability to balance individual stakeholder requirements with data quality, consistency, and broad applicability.

Nice To Haves

• Experience with financial data such as prices, market data, transactions, or instruments.
• Familiarity with point-in-time data, look-ahead bias, and survivorship bias.
• Experience with a modern cloud data stack, such as Spark or Databricks, dbt, a cloud warehouse, and orchestration.
• Experience with Airflow, Kafka, and GCP, especially GKE, Dataproc, and BigQuery.
• Experience with Polars, Pandas, Spark, Apache Beam, or Apache NiFi.
• Experience at a trading firm, systematic fund, brokerage, crypto exchange, or market data company.
• On-call or incident response experience.

Responsibilities

• Work with quants to turn underspecified research questions into aligned, adjusted, point-in-time-correct, documented, and reproducible datasets.
• Develop and own the end-to-end lifecycle of data products, including building and maintaining pipelines, developing quality checks, resolving day-to-day operational issues, and systematizing or automating manual processing.
• Design data quality checks and alerts that identify problems that could harm a strategy while avoiding noisy checks.
• Build shared foundations such as reference data, instrument identifiers, corporate actions, and vendor feeds used by researchers and trading desks.
• Help keep critical data pipelines running across markets in several regions and digital asset markets that operate continuously, as part of a team supporting them across time zones.
• Collaborate with teams and stakeholders across the organization to improve systems and data-related workflows and maximize the value extracted from data.

Benefits

• Eligibility to share in the company’s success through annual discretionary variable remuneration based on company, group, and individual performance and contribution.

What This Job Offers

• Job Type: Full-time
• Education Level: No Education Listed