Data Platform Engineer

Team Cymru•Lake Mary, FL

1d•Remote

About The Position

Team Cymru is seeking a Data Platform Engineer to design and build Go services and pipelines that power its data lake. The engineer will own how raw data is collected, cleaned, conformed, and transformed into trusted, business-ready datasets across bronze, silver, and gold layers. The role involves significant technical ownership and close collaboration with stakeholders to turn domain knowledge into reliable, production-grade systems. It is suited to an engineer comfortable with hands-on coding, system design, and mentoring in a mission-driven threat intelligence environment. The position is remote. Occasional travel for team meetings or industry events may be required. Responsibilities may evolve as needed.

Requirements

At least 7 years of professional software engineering experience, including at least 3 years building and operating production Go systems at scale.
Deep Go fluency, including concurrency with goroutines, channels, and context; profiling and performance tuning; memory management; and idiomatic testing.
Hands-on experience building and running a production data lake using the Medallion Architecture (bronze, silver, and gold).
Strong working knowledge of an open table format such as Apache Iceberg, Delta Lake, or Apache Hudi, and columnar formats such as Parquet.
Experience with object storage such as S3, GCS, or ADLS, and with partitioning, compaction, and schema evolution at scale.
Demonstrated experience designing distributed systems and reasoning about trade-offs in scalability, reliability, latency, and cost.
Experience working with large or high-velocity datasets.
Experience building and maintaining ClickHouse and PostgreSQL databases.
Excellent written and verbal communication skills, including explaining technical trade-offs to non-engineering stakeholders.
A collaborative, low-ego approach to technical disagreement, mentorship, and cross-team problem-solving.
Bachelor’s degree in Computer Science, Software Engineering, or a related field, or equivalent practical experience.

Nice To Haves

Familiarity with streaming or batch data pipeline technologies.
Genuine interest in cybersecurity or threat intelligence; prior domain experience is a plus but is not required.
Experience with threat intelligence data domains such as network flow data, DNS, malware analysis, or OSINT.
Experience with AWS and infrastructure-as-code tooling.
Familiarity with industry-relevant security frameworks or standards such as MITRE ATT&CK and STIX/TAXII.
Prior experience in a startup or fast-scaling engineering organization, including comfort with ambiguity and shifting priorities.
Open-source contributions or a public track record of technical writing or speaking.

Responsibilities

Design, build, and operate large-scale, high-throughput systems for collecting, processing, enriching, and ingesting threat intelligence data into the data lake.
Own all layers of the data lake: bronze, silver, and gold.
Choose and tune table formats, partitioning, compaction, and file layout to balance cost, latency, and query performance.
Own significant components or services end-to-end, from technical design through deployment, monitoring, and iteration in production.
Write clean, well-tested, maintainable Go code and contribute to engineering standards and practices.
Participate in architectural decisions, design reviews, and technical planning, providing informed input on trade-offs involving scale, latency, and data integrity.
Work directly with threat intelligence analysts and researchers to translate investigative workflows and detection logic into scalable software.
Collaborate with product, security, and data teams to prioritize work that affects customer and analyst outcomes.
Improve the reliability, performance, and observability of existing systems, including participating in on-call for owned services.
Mentor engineers through code review, pairing, and technical guidance, and help improve engineering quality across the team.