Topsort-posted 2 months ago
Full-time • Mid Level
Hybrid • Somerville, MA
51-100 employees
Wholesale Trade Agents and Brokers

As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines. You will collaborate with cross-functional teams to ensure the availability, reliability, and efficiency of data systems, enabling data-driven decision-making across the organization.

  • Design, develop, and maintain robust ETL/ELT pipelines to process and transform large datasets efficiently.
  • Optimize data architecture and storage solutions to support analytics, machine learning, and business intelligence.
  • Work with cloud platforms (AWS) to implement scalable data solutions.
  • Ensure data quality, integrity, and security across all data pipelines.
  • Collaborate with data scientists, analysts, and software engineers to support data-driven initiatives.
  • Monitor and troubleshoot data workflows to ensure system performance and reliability.
  • Create APIs to provide analytical information to our clients.
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 2+ years of experience in data engineering or a related field.
  • Strong proficiency in SQL and database technologies with (e.g., PostgreSQL, MySQL, Snowflake, BigQuery).
  • Experience with data pipeline orchestration tools (e.g., Apache Airflow, Prefect, Dagster).
  • Proficiency in programming languages such as Python and Scala.
  • Hands-on experience with AWS cloud data services.
  • Familiarity with big data processing frameworks like Apache Spark.
  • Knowledge of data modeling, warehousing concepts, and distributed computing.
  • Experience implementing CI/CD for data pipelines.
  • Real-time data processing and streaming architectures (RisingWave, Kafka, Flink).
  • Database performance tuning and query optimization.
  • Strong problem-solving skills and the ability to work independently and collaboratively.
  • ETL/ELT pipeline development and automation.
  • Cloud computing and infrastructure management on AWS.
  • Direct Feedback and Rapid Growth.
  • Be part of an elite and collaborative sports team.
  • Intellectual Rigor and Individuality.
  • Company Offsite and Industry Exposure.
  • Working Equipment and Hubs.
  • Flexible PTO schedule with floating holidays.
  • Meditation App, Birthday and Anniversary Celebrations.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service