Data Engineer

DriveWealthNew York, NY
12d$130,000 - $150,000Hybrid

About The Position

The Data & Analytics team is dedicated to building innovative data products that provide actionable insights, empowering our partners to succeed. We focus on curating and maintaining key data sources and statistics that serve both internal and external stakeholders. We are seeking a Data Engineer to join our growing team. This role will work closely with cross-functional teams to interpret and clarify requirements, architecting efficient and scalable data solutions. You'll play a key part in shaping the future of data at DriveWealth, balancing competing priorities and laying the groundwork for long-term growth while delivering high-quality data products. Finally, the candidate should be excited about coming into a team in the process of shaping the direction of data and analytics at DriveWealth, this means balancing competing priorities and laying the groundwork for scale.

Requirements

  • 3+ years working on data ingestion (CSV, JSON, REST), data transformation (DBT), and orchestrating data pipelines (Databricks and/or Airflow)
  • Experience working within a larger data team: CI/CD process leveraging GitHub and AGILE development where possible
  • Programming Languages: Python, SQL, Spark (PySpark, Spark SQL)
  • Declarative Languages: YAML, Terraform
  • Databases: DynamoDB, Unity Catalog, PostgreSQL, SQL Server
  • BS in Computer Science or equivalent program
  • Applicants must be authorized to work for any employer in the U.S. DriveWealth is unable to sponsor or take over sponsorship of an employment Visa at this time.

Nice To Haves

  • Experience with the financial market and trading concepts
  • Familiarity with regulatory and compliance-driven reporting (e.g. FINRA, GDPR).
  • Experience with business intelligence reporting (Sigma)

Responsibilities

  • Build and maintain scalable data pipelines using Databricks, Python, and SQL, implementing a "Medallion" architecture (Bronze/Silver/Gold) to support financial and brokerage functions.
  • Own the transformation layer using dbt, ensuring that complex financial logic is codified into high-performance, modular, and reusable data models.
  • Develop and monitor end-to-end ELT/ETL processes, leveraging Databricks Workflows or Airflow to ensure timely and reliable data delivery.
  • Optimize Spark jobs and SQL queries for maximum efficiency, managing compute costs while improving data latency.
  • Implement rigorous data quality checks and validation frameworks (using dbt tests and custom Python) to ensure "source of truth" accuracy across trade and transaction data.
  • Optimize SQL query performance for the reporting suite
  • Collaborate with product and engineering teams to understand data requirements and proactively address future feature needs

Benefits

  • Competitive medical, dental, and vision insurance options
  • Mental health resources
  • Generous paid time off with observed holidays (varies per country)
  • Paid parental leave for biological and adoptive parents
  • Up to $2,500 or local equivalent each year to invest in continued education and personal development
  • Up to $900 each year or local equivalent for fitness and wellness reimbursement
  • Company-provided phone (varies by country)
  • For HQ in-office employees, a daily lunch stipend, unlimited snacks, and engaging office space in the Financial District
  • Pre-tax commuter benefits (US only)
  • Employer 401K match (US only)
  • Benefit offerings vary based on country and are subject to change.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service