Senior Software Engineer, Data Platform

Covariance.ai • New York, NY

89d • $145,000 - $220,000

About The Position

Hiring for multiple roles. Traditional forecasting breaks under petabytes of features, megabytes of labels, and time-varying noise. Our breakthrough research is foundational in the field: generating industry-beating results (MIT News). Our predictive engines combine a wide variety of data through rigorous scientific process. We leverage alternative datasets (consumer transactions, geolocation, etc) along with private, public, external, and internal data. The Data Platform is a critical component in our scientific approach to forecasting. The role will require everything from high-level architecture design to performant implementation.

Requirements

• Bachelor’s or advanced degree in Computer Science, math or equivalent
• 3+ years of experience in data engineering or related fields with a track record of building (coding) and scaling a data platform
• 2+ years of industry experience building ETL pipelines in a major cloud provider
• Highly proficient in python and SQL
• Advanced knowledge of databases, design patterns, OOP, and concurrency
• Knowledge of data management fundamentals and data storage principles
• Passion for intuitive data models
• Experience communicating with senior management as well as colleagues from engineering, analytics, and business backgrounds
• Experience with AWS, orchestration platforms, and modern tech stacks
• Strong software engineering fundamentals: system design, algorithms, data structures

Nice To Haves

• Experience building systems that integrate LLMs with large-scale data processing
• Working understanding of basic probability and statistics
• Experience implementing ML models
• Experience with DBT
• MS or PhD in STEM field

Responsibilities

• Build distributed systems supporting complex transformations over petabyte-scale data
• Design, implement, and maintain production cloud data pipelines for complex, disparate datasets
• Work closely with our Quants and Applied Scientists to support rigorous scientific process, rapid experimentation, and new product initiatives

Benefits

• The salary range for this position is $145,000-$220,000
• Free health, vision, dental insurance
• 401k with match
• Unlimited PTO + 13 company holidays
• Daily Grubhub lunch stipend
• Pre-tax commuter benefits

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: Bachelor's degree
• Number of Employees: 1-10 employees