ARM Data Center (ADC) Computational and Storage Resources for the Scientific and Infrastructure Users

 

Authors

Robert James Records — Oak Ridge National Laboratory
Anthony Clodfelter — Oak Ridge National Laboratory
Everett Rush — Ut-Battelle
Nicole Noel Keck — Pacific Northwest National Laboratory
Giri Prakash — Oak Ridge National Laboratory

Category

ARM infrastructure

Description

ARM focuses on obtaining continuous measurements--supplemented by field campaigns--and providing data products that promote the advancement of climate models. Serving users worldwide, the ARM Data Center collects and archives approximately 20 terabytes of data per month. The ARM Data Center (ADC) domain increasingly depends on the ability to efficiently receive, verify, validate, analyze, and steward large volumes of instrument data. Efforts to streamline these processes in preparations for expedient data delivery include upgrading hardware, changing reception workflows, increasing network throughput, and designing parallel processes to complete all data checks, database updates, and storing of files to four operational locations. The ARM Data Center staff has architected a multiple-file-server workflow that will provide robust collection, processing, validation, and quick delivery capabilities to both operations and scientific users. These resources include data archive, data project, and new processing clusters for operations and model simulations. This poster session explains the new resources, how to access and use them, and who to contact with any questions.