Data Systems Engineer II (ARM-related)


The Environmental Sciences Division (ESD) of Oak Ridge National Laboratory (ORNL) has an opening for a Data Systems Engineer in its Earth Sciences Informatics portfolio. You will help develop modular and scalable software tools and infrastructure for data processing and data center operations in the Earth, climate, and environmental sciences, such as the Atmospheric Radiation Measurement (ARM) Data Center.

Major Duties/Responsibilities: ARM Data Center processes, archives and distributes atmospheric observations from observatories across the globe and provides computational infrastructure and analysis tools for the scientific community. In this position, you will work independently and as part of a team to research, develop and operate back-end data analysis workflows and processes at scale in a HPC environment. You will have the opportunity to design and develop new creative solutions for increasing large volumes of historical and streaming data analysis on hybrid HPC and cloud computing platforms. This would require formulating necessary solutions using various parallel computing paradigms and tools, HPC schedulers (such as Slurm), Containers and Kubernates, Python, Bash and other scripting/programming languages in the Linux environment. You should be able to configure, deploy and update containers in a Docker/Kubernates environment using GitLab CI/CD pipelines. You should be able to develop documentation for systems/applications deployed. You should be able/willing to learn new technologies/techniques to meet programmatic requirements.