Data Platform Engineer

Team Cymru • Lake Mary, FL

1d • Remote

About The Position

Team Cymru is seeking a Senior Software Engineer to design and build Go services and pipelines that power its data lake. The engineer will own how raw data is collected, cleaned, conformed, and transformed into trusted, business-ready datasets across bronze, silver, and gold layers. The role carries significant technical ownership and involves working with stakeholders to turn domain expertise into reliable, production-grade systems. It is suited to an engineer comfortable with hands-on coding, system design, and mentoring in a mission-driven threat intelligence environment.

The position involves designing, building, and operating high-throughput systems for threat intelligence data, choosing and tuning data lake formats and layouts, and owning services through design, deployment, monitoring, and production iteration. The engineer will partner with threat intelligence analysts and researchers, collaborate across product, security, and data teams, improve system reliability and observability, participate in on-call operations for owned services, and mentor engineers.

This is a remote position. Occasional travel for team meetings or industry events may be required.

Requirements

• 7+ years of professional software engineering experience, including 3+ years building and operating production Go systems at scale.
• Deep Go fluency, including concurrency with goroutines, channels, and context; profiling and performance tuning; memory management; and idiomatic testing.
• Hands-on experience building and running a production data lake using the Medallion Architecture (bronze, silver, and gold).
• Strong working knowledge of an open table format such as Apache Iceberg, Delta Lake, or Apache Hudi, and columnar formats such as Parquet.
• Experience with object storage such as S3, GCS, or ADLS, and with partitioning, compaction, and schema evolution at scale.
• Demonstrated experience designing distributed systems and reasoning about trade-offs in scalability, reliability, latency, and cost.
• Experience working with large or high-velocity datasets.
• Experience building and maintaining ClickHouse and PostgreSQL databases.
• Excellent written and verbal communication skills, including explaining technical trade-offs to non-engineering stakeholders.
• A collaborative, low-ego approach to technical disagreement, mentorship, and cross-team problem-solving.
• Bachelor’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.

Nice To Haves

• Familiarity with streaming or batch data pipeline technologies.
• Genuine interest in cybersecurity or threat intelligence; prior experience in the domain is a plus.
• Experience with threat intelligence data domains such as network flow data, DNS, malware analysis, or OSINT.
• Experience with AWS and infrastructure-as-code tooling.
• Familiarity with industry security frameworks or standards such as MITRE ATT&CK and STIX/TAXII.
• Prior experience in a startup or fast-scaling engineering organization, including comfort with ambiguity and shifting priorities.
• Open-source contributions or a public track record of technical writing or speaking.

Responsibilities

• Design, build, and operate large-scale, high-throughput systems for collecting, processing, enriching, and ingesting threat intelligence data into the data lake.
• Own all layers of the data lake: bronze, silver, and gold.
• Choose and tune table formats, partitioning, compaction, and file layout to balance cost, latency, and query performance.
• Own significant components or services end-to-end, from technical design through deployment, monitoring, and iteration in production.
• Write clean, well-tested, maintainable Go code and contribute to engineering standards and practices.
• Participate in architectural decisions, design reviews, and technical planning, providing informed input on trade-offs involving scale, latency, and data integrity.
• Partner with threat intelligence analysts and researchers to translate investigative workflows and detection logic into scalable software.
• Collaborate with product, security, and data teams to prioritize work that affects customer and analyst outcomes.
• Improve the reliability, performance, and observability of existing systems, including participating in on-call for owned services.
• Mentor engineers through code review, pairing, and technical guidance, and help raise engineering quality across the team.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior