Data Engineer

SmartAsset•New York, NY

28d•Remote

About The Position

SmartAsset is an online destination for consumer-focused financial information and advice, whose mission is helping people make smart financial decisions, reaching over an estimated 59 million people each month (as of January 2025) through our educational content and personalized calculators and tools. To extend our mission, we also operate SmartAsset Advisor Marketing Platform (AMP), which helps connect consumers with fiduciary financial advisors.SmartAsset has earned recognition on the Inc. 5000 (#2574 in 2023) and Deloitte Technology Fast 500™ (#250 in 2022) lists. Currently, SmartAsset ranks on Y Combinator’s list of Top 100 Companies. A successful $110 million Series D funding round in 2021 valued the company at over $1 billion. Other than application and licensing fees, SmartAsset did not provide compensation for the aforementioned awards. About the team: SmartAsset’s Data Engineering team builds and maintains the scalable, low-latency systems that power data access across the company. Our platform supports real-time and batch data needs for analytics, reporting, and machine learning, serving teams across Marketing, Product, Sales, and Finance. You’ll be part of a growing data organization that includes analysts, data scientists, and ML engineers that are at the forefront of AI/ML application for the company. As a Senior Data Engineer, you'll work cross-functionally to evolve our architecture, optimize data latency, and build robust solutions that enable data-driven decisions at scale. About the Job: SmartAsset is looking for a seasoned Senior Data Engineer with 7+ years of hands-on experience to help build and optimize the backbone of our data platform. In this role, you’ll design and implement high-impact, cloud-native solutions that improve data reliability, reduce latency, and scale with our growing business. You’ll play a key role in enabling data products, real-time analytics, and cross-functional decision-making by delivering clean, well-structured, and accessible data.

Requirements

Bachelor of Science degree in Computer Science or equivalent practical experience.
4+ years of dedicated experience building and maintaining complex ETL/ELT pipelines.
3+ years of Python development experience, specifically building production-grade data APIs using FastAPI or similar frameworks.
Strong expertise in SQL, including advanced query optimization and performance tuning.
Expert-level proficiency in dbt implementation, including managing models, macros, and incremental and dynamic tables.
Extensive hands-on experience with Snowflake, including performance optimization, data recovery using Time Travel, and advanced data modeling techniques.
Practical experience with key AWS data services such as Kinesis, Firehose, Redshift, Spectrum, Elastic MapReduce, and Lambda; and container orchestration services like ECS and EKS for deploying and managing data applications.

Nice To Haves

Proven experience designing and building near real-time data processing systems.
Experience with data observability tools for proactive monitoring of data quality, lineage, and pipeline health.
Familiarity with modern data orchestration platforms such as Argo or Airflow.
Hands-on experience with the full software development lifecycle (SDLC), including strong CI/CD practices for data pipelines and proficiency with data testing frameworks.
Demonstrated ability to identify and adopt new technologies that improve data quality and reliability.
Deep understanding of the data lifecycle, emphasizing the importance of high-quality data in applications, machine learning, business analytics, and reporting.
Proven track record of mentoring junior team members.
Experience with data ingestion tools like Singer is a plus.
Knowledge of analytics tools such as Tableau, Plotly, and Pandas.
Experience in the financial services industry.

Responsibilities

Architect, design, implement, and operate end-to-end data engineering solutions using Agile methodology.
Develop and manage robust data integrations with external vendors and organizations (including complex API integrations).
Collaborate closely with Data Analysts, Data Scientists, DBAs, and cross-functional teams to understand requirements and deliver high-impact data solutions.
Lead and take ownership of assigned technical projects in a fast-paced environment.
Drive continuous improvement in the quality, security, efficiency, and scalability of our data pipelines and infrastructure.

Benefits

All roles at SmartAsset are currently and will remain remote - flexibility to work from anywhere in the Contiguous US.
Medical, Dental, Vision - multiple packages available based on your individualized needs
Life/AD&D Insurance - basic coverage at 100% company paid, additional supplemental available
Supplemental Short-term and Long-term Disability
FSA: Medical and Dependant Care
401K
Equity packages for each role
Time Off: Vacation, Sick and Parental Leave
EAP (Employee Assistance Program)
Financial Literacy Mentoring Program
Pet Insurance
Home Office Stipend