Sr Engineer Software

Fanatics • San Mateo, CA

6h • Hybrid

About The Position

The Streaming Data Platform team builds and operates large-scale, real-time stream processing systems using modern open-source technologies. We design pipelines that power analytics, reporting, and downstream product use cases by delivering high-quality data with low latency and high reliability. We’re looking for a Senior Software Engineer to help design, build, and operate streaming data pipelines and storage systems that support near real-time analytics and diverse access patterns across Fanatics Commerce.

Requirements

• 5+ years of professional software engineering and/or data engineering experience
• Kafka experience is a must (designing, building, and operating Kafka-based streaming systems in production)
• Hands-on experience building and operating production streaming pipelines with low-latency requirements
• Experience integrating streaming systems with MPP analytical databases such as StarRocks, Apache Pinot, or Apache Druid
• Solid understanding of data skew challenges and mitigation techniques (bucketing, salting, repartitioning, adaptive strategies)
• Working knowledge of Apache Iceberg for streaming or near-real-time workloads, including table layout and compaction concepts
• Proficiency in Java and/or Python
• Strong SQL skills and understanding of distributed query execution and performance tuning
• Familiarity with data distribution strategies such as tablet distribution, bucketing, and colocation concepts
• Experience operating data pipelines in production, including monitoring, alerting, and incident response

Nice To Haves

• Experience contributing to open-source data or analytics projects
• Exposure to materialized views, primary key models, or real-time OLAP optimizations
• Experience working with large-scale event-driven architectures and high-throughput data systems

Responsibilities

• Design, build, and operate real-time streaming data pipelines with low-latency delivery to MPP databases such as StarRocks, Apache Pinot, and Apache Druid
• Implement and maintain data pipelines that handle moderate to high data skew, applying techniques like bucketing, salting, and adaptive partitioning
• Work with Apache Iceberg tables for streaming workloads, including partitioning strategies, compaction tuning, file sizing, and snapshot management
• Collaborate with platform and analytics teams to model data for different consumption patterns, including real-time dashboards and analytical queries
• Optimize streaming jobs and storage layouts to improve query performance, reduce latency, and control infrastructure cost
• Assist in diagnosing and resolving performance bottlenecks related to ingestion, skew, and distributed query execution
• Contribute code, reviews, and documentation to shared data platform components and internal frameworks
• Participate in design discussions and provide technical input on streaming architecture and data modeling decisions

Benefits

• We provide a wide range of health, financial, legal, and development assistance, including wellness programs with fitness and weight management partners, paid maternity paternity leave, and infertility treatment.
• Additionally, we offer flexible time off to help you recharge, along with a competitive 401k plan to support your financial future.
• At Fanatics, we’re dedicated to supporting you in all aspects of work and life.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed