Principal Data Engineer

Recorded Future•Boston, MA

40d•$152,000 - $228,500

About The Position

With 1,000+ intelligence professionals serving over 1,900 clients worldwide, Recorded Future is the world’s most advanced, and largest, intelligence company! We are looking for a Data Engineer to improve the Security Intelligence Graph. As a Data Engineer, you will build production-grade pipelines to drive data convergence from various sources within the graph, ensure that Indicators of Compromise (IOCs) are properly attributed, and improve the quality of the graph at scale.

Requirements

6+ years of Python programming
2+ years of experience with cloud computing tools, e.g. from AWS, Azure, or Google Cloud
1+ years of experience leading and/or mentoring other teams members
Experience writing scalable, production-grade applications and ETL/ELT pipelines
Efficient & accurate problem solving skills, including the ability to debug both software and data
Proven ability to analyze data and apply statistical techniques to draw accurate, impactful conclusions
Proven success in delivering projects from design and implementation to release
Excellent attention to detail & ability to work independently while delivering high-quality results
Excellent written & verbal communication when collaborating with colleagues across various locations and timezones, designing technical approaches, and writing documentation
Eagerness to continue learning and teaching new skills to team members, in order to raise the bar across the team

Nice To Haves

Familiarity with both batch and streaming pipelines
Familiarity with any of the following: message buses (e.g. Kafka, RabbitMQ), NoSQL databases (e.g. MongoDB, AWS Neptune, Neo4j), ElasticSearch
Bachelor's/Master's degree in Computer Science, Mathematics, Statistics, Engineering, or equivalent experience
Exposure to ML approaches, including experience productizing ML models
Experience with developing REST APIs with Python frameworks (e.g. Flask, Django, FastAPI)
Leadership experience, with a track record of presenting information to stakeholders with varying levels of technical expertise

Responsibilities

Work with the Graph Quality team to align, analyze, and ingest asset maps into the Security Intelligence Graph
Develop, productize, monitor, and maintain data pipelines to analyze and ingest data at scale
Lead a team of Data Engineers on by providing guidance on projects and direction of best practices
Build tools and APIs to facilitate access to data and analytics developed from the intelligence graph
Analyze and explain patterns in data to drive business-critical decisions
Create technical project plans and drive the successful execution of projects, with input from our Product team and other developers on the team
Collaborate with Data Scientists, Data Engineers, and business leaders to develop and refine technical solutions
Onboard and guide junior members of the team
Assist in setting team goals, planning sprints, and leading Agile scrum meetings