Py-ART and CMAC2.0: Open Science for Supporting ASR and ARM.
Authors
Scott Matthew Collis — Argonne National Laboratory
Zachary Scot Sherman — Argonne National Laboratory
Robert Jackson — Argonne National Laboratory
Jason Hemedinger — Argonne National Laboratory
Sherman Beus — Pacific Northwest National Laboratory
Zach Price — Oak Ridge National Laboratory
Krista Gaustad — Pacific Northwest National Laboratory
Category
ARM infrastructure
Description
CMAC2.0 applied to ARM's X-SAPR at the Southern Great Plains site. Visualization produced using Py-ART with new color vision deficiency friendly colormaps.
The ARM User Facility operates a heterogeneous network of complex radar systems tasked with observing a wide range of geophysical phenomena. There are also a wide range of stakeholders in terms of level of comfort with complex remote sensing data and science questions being asked. As the radar data produced “out of the box” is only useful to domain experts (or those lucky enough to have access to one) ARM needs to add value to the lower level datastream. To achieve this a dual pronged approach was taken. First, engineer an open, community based architecture to allow savvy users to construct application chains in the Python programming language and to use pre-defined routines to visualize, QC and gain insight from ARM radar data. Second, couple this architecture to ARM’s Data Integrator (ADI) and scale to the ARM Data Center’s HPC resources in order to produce ARM standard Value Added Products (VAPs). The application chains are constructed in the Python-ARM Radar Toolkit and the visualizations in the Corrected Moments in Antenna Coordinates (Version 2) VAP, CMAC2.0. By adhering to community standard sustainability practices (Version control, unit testing, self documentation and Continuous Integration) Py-ART has enjoyed rapid adoption by the community (65K+ downloads, 67 citations since 2015) and this directly benefits ARM through CMAC2.0 since new capabilities contributed to Py-ART can be implemented simply in CMAC2.0 as it is coupled to ARM infrastructure through ADI. This presentation will update the community on our progress through the Py-ART roadmap, highlight several Py-ART use cases, provide an overview of the actions performed by CMAC2.0 and an update on CMAC2.0’s progress and data availability.
