Senior Staff Software Engineer - Data Acquisition

IntelliPro Group Inc.
78d$169,000 - $225,000

About The Position

As a Senior Staff Software Engineer, you will play a key role in designing and developing scalable, high-throughput data acquisition systems that power IntelliPro’s Data-as-a-Service (DaaS) platform. You’ll architect and implement ingestion frameworks capable of handling billions of records daily across diverse internal and external data sources, ensuring performance, reliability, and security at scale. You’ll collaborate cross-functionally with platform, infrastructure, and DataOps teams to embed data governance, observability, and automation into the core of our data ingestion process—helping to build the foundation for analytics, AI, and enterprise-wide data solutions.

Requirements

  • 10+ years of experience in software engineering or platform architecture, focusing on distributed systems or high-volume data processing.
  • Deep expertise in data acquisition techniques such as CDC (Change Data Capture), event-driven ingestion, and streaming data frameworks.
  • Advanced programming skills in Python, Java, Scala, or Go.

Responsibilities

  • Lead the architecture and implementation of scalable, high-throughput data acquisition frameworks integrating multiple internal and external systems.
  • Design modular ingestion pipelines supporting batch, streaming, and event-driven data flows.
  • Develop core platform components including data routing, transformation orchestration, lineage tracking, and schema evolution.
  • Collaborate with internal platform and data teams to ensure governance, observability, and reliability throughout the ingestion process.
  • Provide technical mentorship and leadership, setting high engineering standards in scalability, security, and automation.
  • Partner with business and product teams to accelerate data onboarding using reusable frameworks and automation tools.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service