Data Engineer

Spot Inc.Tampa, FL
3hOnsite

About The Position

Red Technologies is seeking a Data Engineer with a strong passion for building scalable, reliable data platforms that power analytics, decision-making, and operational systems. Our team is responsible for turning complex, high-volume data into accessible, actionable insights for our customers, carriers, and internal teams. In this role, you will take ownership of critical components of our data platform and pipelines, partner closely with data science, analytics, and software engineering teams, and help evolve our architecture as we ingest and process increasingly large and complex datasets. You’ll work on everything from batch and streaming pipelines to data modeling, governance, and performance optimization. If you enjoy solving real business problems with data and want to have a direct impact on daily operations, this role is for you.

Requirements

  • 3+ years of experience building and maintaining data pipelines using tools such as PySpark, Pandas, SQL, and similar technologies.
  • Bachelor’s degree in Data Engineering, Computer Science, a related field, or equivalent real-world experience.
  • Strong understanding of data modeling, joins, aggregations, and analytical patterns.
  • Solid experience working with cloud and distributed data systems.
  • Proven ability to debug complex data issues and deliver reliable solutions in production environments.
  • Strong problem-solving skills, attention to detail, and ownership mindset.
  • Ability to independently research, evaluate, and adopt new tools and technologies.

Nice To Haves

  • Experience with Azure, Databricks, Azure Synapse, SQL Server, and/or Kafka is a plus.
  • Experience in logistics, transportation, or supply chain environments is a plus.

Responsibilities

  • Design, build, and support Red Technologies’ data and business intelligence platform using Databricks, Azure Synapse, Sigma Computing, and SQL Server.
  • Own and maintain production-grade data pipelines that reliably serve data scientists, analysts, internal applications, and customer-facing systems.
  • Lead or contribute to the ingestion of near-real-time and streaming data into the platform.
  • Partner with software engineers, product managers, analysts, and non-technical stakeholders to translate business needs into scalable technical solutions.
  • Design and implement data quality checks, testing frameworks, and governance processes to ensure accuracy, reliability, and trust in our data.
  • Optimize data models, queries, and pipelines for performance, scalability, and cost efficiency.
  • Contribute to architectural decisions and help guide best practices across the data engineering stack.
  • Mentor junior team members and help raise the overall technical bar of the team.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service