Data Engineer

Shift5•Arlington, VA

18d•$130,000 - $170,000•Remote

About The Position

Shift5 is seeking a Data Engineer to join their growing Product Engineering team. The primary responsibility will be to design, build, and maintain data processing, storage, and integration pipelines. This role reports to the Off Vehicle Manager, Software Engineering, and operates in a team-based environment with engineers, product managers, program managers, and designers to conceive, implement, and shape major features. The Data Engineer will be a major factor in generating high-impact products that literally save lives.

Requirements

2+ years of software/data engineering experience with a deep understanding of software engineering practices and concepts.
2+ years of experience with a major programming language (GoLang, Java, or Python).
2+ years of relational database experience (PostgreSQL, MySQL, Oracle, etc.).
2+ years of experience with Big Data (Hadoop, Spark) and Data Modeling.
2+ years of experience with containerization and cloud services (Docker, Kubernetes) and cloud monitoring tools.
Expertise with batch and streaming data pipelines using technologies such as Apache Airflow or Benthos.
Familiarity with modern data stack components including data ingestion, transformation, and orchestration.
U.S. citizenship required and ability to obtain a security clearance.
Experience and understanding of data lakes/warehouses (e.g., Snowflake, Databricks, Redshift).
Proficiency with CI/CD, source control, design reviews, and integrating observable practices.
Willingness to travel occasionally to customer and partner sites to support field integration and deployment efforts.

Responsibilities

Design, build, and maintain robust, scalable batch and streaming data processing, storage, and integration pipelines.
Interpret requirements and design specifications, taking full ownership of building features from the ground up.
Write clean, well-documented, scalable, extensible, and testable code to ensure application quality and maintainability.
Partner with data scientists and engineers to create semantic data models representing complex vehicular systems, and integrate applications cleanly across other Shift5 componentry.
Build scalable data products for data scientists, transportation engineers, and executives to drive insights and decision-making.
Create efficient, reliable, cost-effective, dynamically scalable, and observable solutions utilizing AWS cloud services.
Analyze complex data sets to create data ontologies, verify data quality/integrity, and ensure data accuracy throughout pipelines.
Support the design process and occasionally travel to customer sites (estimated a few times per year) to collaborate with Field Engineers on data integration and deployment.