Principal Engineer, Data Platform
About The Position
The Data Platform team is uniquely positioned at the intersection of security, big data and cloud computing. We are responsible for providing ultra low-latency access to global security insights and intelligence data to our customers, and enabling them to act in near real-time. We're looking for a seasoned engineer to help us build next-generation data pipelines that provide near real-time ingestion of security insights and intelligence data using cloud and open source data technologies What's in it for you You will be part of a growing team of renowned industry experts in the exciting space of Data and Cloud Analytics Your contributions will have a major impact on our global customer-base and across the industry through our market-leading products You will solve complex, interesting challenges, and improve the depth and breadth of your technical and business skills.
Requirements
- Proven track record of building and operating highly scalable and fault-tolerant data processing systems
- Prior experience designing and building efficient data pipelines for batch and real-time processing using technologies such as Kafka, PubSub, Kinesis, Postgres etc.
- Prior experience building & operating highly reliable RPC services e.g. based on gRPC, and strong knowledge of serialization formats (e.g., ProtoBuf)
- Solid grasp of distributed storage systems (e.g. S3), including their consistency models, scaling properties and efficient data serialization techniques (e.g., Parquet, ORC)
- Proficient in Golang, Java, or similar languages, Kubernetes and Linux
- Excellent written and verbal communication skills
- Willingness to work with a globally distributed team in different time zones.
Responsibilities
- Building next generation data pipeline for near real-time ingestion of security insights and intelligence data
- Partnering with industry experts in security and big data, product and engineering teams to conceptualize, design and build innovative solutions for hard problems on behalf of our customers.
- Evaluating open source technologies to find the best fit for our needs and also contributing to some of them!
- Helping other teams architect their systems on top of the data platform and influencing their system design.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Principal
Industry
Publishing Industries
Number of Employees
1,001-5,000 employees
