Data Systems Software Engineer

Oak Ridge National Laboratory•Oak Ridge, TN

4d•Onsite

About The Position

The Environmental Sciences Division (ESD) of Oak Ridge National Laboratory (ORNL) has an opening for a Data Systems Software Engineer, in its Earth Sciences Informatics portfolio. You will help develop modular and scalable software tools and infrastructure for data processing and data center operations in the Earth, climate, and environmental sciences, such as the Atmospheric Radiation Measurement (ARM) Data Center. ARM Data Center processes, archives and distributes atmospheric observations from observatories across the globe and provides computational infrastructure and analysis tools for the scientific community. In this position, you will: Work independently and as part of a team to research, develop and operate back-end data analysis workflows and processes at scale in a HPC environment. Design and develop new creative solutions for increasing large volumes of historical and streaming data analysis on hybrid HPC and cloud computing platforms. Formulating necessary solutions using various parallel computing paradigms and tools, HPC schedulers (such as slurm), Containers and Kubernetes, Python, Bash and other scripting/programming languages in the Linux environment. Configure, deploy and update containers in a Docker/Kubernetes environment using GitLab CI/CD pipelines. Develop documentation for systems/applications deployed. Able/willing to learn new technologies/techniques to meet programmatic requirements Deliver ORNL’s mission by aligning behaviors, priorities, and interactions with our core values of Impact, Integrity, Teamwork, Safety, and Service. Promote equal opportunity by fostering a respectful workplace – in how we treat one another, work together, and measure success.

Requirements

BS degree in computer science, information systems or related field
Two years of progressive systems engineering experience in a Linux environment
Full-stack system development experience
Knowledge and experience in scripting language(s) (Python, Bash, PERL)
Experience in working in a CI/CD environment with docker container deployment is required
Experience with managing a Kubernetes container environment is a must
Good communication skills in English, both oral and written
Desire to learn and adopt new tools and technologies as required by the projects

Nice To Haves

Experience in Python and PostgreSQL
Experience working in a HPC environment (SLURM, pbs)
Experience in Vue.js, FastAPI, and other frontend development tools
Virtualization and container infrastructure experience (VMWare)
Excellent written and oral communication skills
Motivated self-starter with the ability to work independently and to participate creatively in collaborative teams across the laboratory
Ability to function well in a fast-paced research environment, set priorities to accomplish multiple tasks within deadlines, and adapt to ever changing needs

Responsibilities

Work independently and as part of a team to research, develop and operate back-end data analysis workflows and processes at scale in a HPC environment.
Design and develop new creative solutions for increasing large volumes of historical and streaming data analysis on hybrid HPC and cloud computing platforms.
Formulating necessary solutions using various parallel computing paradigms and tools, HPC schedulers (such as slurm), Containers and Kubernetes, Python, Bash and other scripting/programming languages in the Linux environment.
Configure, deploy and update containers in a Docker/Kubernetes environment using GitLab CI/CD pipelines.
Develop documentation for systems/applications deployed.
Able/willing to learn new technologies/techniques to meet programmatic requirements
Deliver ORNL’s mission by aligning behaviors, priorities, and interactions with our core values of Impact, Integrity, Teamwork, Safety, and Service. Promote equal opportunity by fostering a respectful workplace – in how we treat one another, work together, and measure success.