Software Engineer, Batch Compute
About The Position
The Software Engineer, Batch Compute role involves designing and developing high-quality software solutions, with a focus on Golang, to build and maintain highly scalable, highly available, and globally distributed systems. This position will manage and optimize data interactions across various databases, develop and operate containerized applications within Kubernetes, and support Linux-based systems. The role also requires applying networking knowledge for performance optimization, diagnosing and resolving complex technical issues, and driving continuous improvement through CI/CD pipelines and engineering best practices. Staying current with emerging technologies is also a key aspect of this role.
Requirements
- Experience with developing Kubernetes components, such as controllers and operators
- Experience with event-driven programming and message queues, such as apache Kafka and Pulsar
- Experience of high-performance computing, Kubernetes, or DAG (Directed Acyclic Graph) workflows
- Experience of operating or using job scheduling systems, e.g. SLURM
- Use of operational and runtime tools and practices, including monitoring and logging with systems such as Prometheus and Grafana
Responsibilities
- Designing and developing high-quality software solutions using procedural programming languages, with a focus on Golang
- Building and maintaining highly scalable, highly available and globally distributed systems to support large-scale research workloads
- Managing and optimising data interactions across relational and non-relational databases, particularly PostgreSQL
- Developing and operating containerised applications within Kubernetes, ensuring effective orchestration and workload scheduling
- Supporting, tuning and troubleshooting Linux-based systems as part of our core compute platform
- Applying core networking knowledge to help debug, optimise and enhance platform connectivity and performance
- Independently diagnosing and resolving complex technical issues across infrastructure and software layers
- Applying solid software architecture principles, computer science fundamentals and data structure knowledge to guide design decisions and code quality
- Driving continuous improvement by contributing to CI/CD pipelines and engineering best practices
- Staying up to date with emerging technologies and approaches, and applying new knowledge across disciplines
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
