Senior Software Engineer (Big Data)

Bitsight

1d•$119,000 - $179,000•Remote

About The Position

Bitsight is looking for an experienced Big Data Engineer to join their engineering team. The company prides itself on building exceptional career opportunities and offering outstanding benefits. Bitsight's mission is to make the online world a safer place by helping governments, companies and NGOs understand and mitigate their cybersecurity risks. This is an internet-scale challenge, tracking every IP address, every piece of malware, and a good portion of the world’s internet traffic. Bitsight’s data pipeline is the core of its Security Ratings product, ingesting security-related intelligence data from many sources, feeding terabytes of data into a proprietary rating algorithm, and delivering ratings for over 1,000,000 organizations daily. The pipeline is built on the highly scalable AWS ecosystem, meeting high standards of reliability and scalability. The role involves working with a close-knit team across multiple locations to architect and evolve the pipeline to support larger volumes via cloud data warehouses. The engineer will bring actionable security insights to customers by integrating new data sources, surfacing new features from existing data, and refining the rating algorithm. Collaboration with data science and research teams is key to building trust with customers in the quality and integrity of the data. The company values strong generalists with critical thinking skills, the ability to use a variety of technologies and languages, and pick up new concepts when needed. Strong collaboration skills are a must, offering an opportunity to make a unique impact on the entire engineering team.

Requirements

Prior experience building and operating large-scale data pipelines
Strong proficiency in modern Java language programming
Strong computer science fundamentals in design, data structures, and algorithms
Experience working with a team of engineers, designers, and product owners in delivering a product to end-users
Excellent (English) written and verbal communication skills

Nice To Haves

Experience with Python
Experience with Hadoop, Spark ecosystems
Experience with Data Lakehouse tech stack (e.g., Apache Iceberg)
Experience with Elasticsearch or OpenSearch
Experience with CI/CD and Kubernetes
Experience with modern AI development tools (e.g., GitHub Copilot, Cursor, or LLMs)
Experience working in the IT security domain

Responsibilities

Architect and evolve the pipeline to support even larger volumes via cloud data warehouses.
Integrate new data sources.
Surface new features from existing data.
Refine the rating algorithm.
Collaborate with data science and research teams to build trust with Bitsight customers in the quality and integrity of our data.