Senior Software Engineer (Big Data)
About The Position
Bitsight is seeking an experienced Big Data Engineer to join its engineering team and help build and operate large-scale data pipelines. Bitsight’s Security Ratings pipeline ingests security intelligence from many sources, processes terabytes of data through a proprietary rating algorithm, and delivers daily ratings for more than 1,000,000 organizations. Built on AWS, the pipeline is designed for reliability and scalability. The engineer will help architect and evolve the pipeline to handle increasing data volumes through cloud data warehouses. The work includes integrating new data sources, surfacing features from existing data, and refining the rating algorithm to deliver actionable security insights. The role collaborates closely with engineers across locations, as well as data science and research teams, to maintain trust in the quality and integrity of Bitsight’s data. Bitsight values adaptable generalists with strong critical-thinking and collaboration skills who can work with a variety of technologies and learn new concepts.
Requirements
- Prior experience building and operating large-scale data pipelines.
- Strong proficiency in modern Java programming.
- Strong computer science fundamentals in design, data structures, and algorithms.
- Experience working with a team of engineers, designers, and product owners to deliver a product to end users.
- Excellent written and verbal communication skills in English.
- Strong collaboration and critical-thinking skills, with the ability to work across technologies and learn new concepts.
Nice To Haves
- Experience with Python.
- Experience with Hadoop or Spark ecosystems.
- Experience with data lakehouse technology, such as Apache Iceberg.
- Experience with Elasticsearch or OpenSearch.
- Experience with CI/CD and Kubernetes.
- Experience with modern AI development tools, such as GitHub Copilot, Cursor, or LLMs.
- Experience working in the IT security domain.
Responsibilities
- Build and operate large-scale data pipelines.
- Help architect and evolve the data pipeline to support larger volumes via cloud data warehouses.
- Integrate new data sources.
- Surface new features from existing data and refine the rating algorithm.
- Collaborate with engineering, data science, and research teams to deliver reliable, high-quality security insights.
Benefits
- Medical, dental, and vision insurance.
- Paid parental leave.
- Flexible time off.
- 401(k) plan with employee and company contribution opportunities.
- Life and disability insurance.
- Tuition reimbursement.
- Eligibility to participate in a bonus or commission plan.
- Equity grant.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
