ARM Archive data extraction capabilities and plans

 
Poster PDF

Authors

Raymond A. McCord — retired
Sean T. Moore — Orbital ATK Inc.
Giri Prakash — Oak Ridge National Laboratory

Category

Infrastructure & Outreach

Description

The ARM Climate Research Facility Data Archive has built into their ordering and delivery process a data extraction sub-system that allows users to request and receive custom data sets, without requiring them to download an entire datastream. This system will extract, rename, and reorder measurements to the user's liking. It will deinterleave specific radar modes from MMCR datastreams. It can deliver output in ASCII or NetCDF format and optionally merge many days’ worth of values into single files. Changes in metadata over time will be detected and reported. Plans for system enhancements include the ability to filter output based on the existence of data quality reports or filter on the existence of specific data quality flags. Filtering based on more general user preference, such as the existence of clouds or precipitation is also being considered. Enhanced slicing by time or other data dimensions is in the works. We encourage feedback from the user community regarding additional requirements for data extraction capabilities that will further improve the effectiveness of the Archive.