A Community Data Set for Comparing Automated Coronal Hole Detection Schemes

Automated detection schemes are nowadays the standard approach for locating coronal holes in extreme-UV images from the Solar Dynamics Observatory (SDO). However, factors such as the noisy nature of solar imagery, instrumental effects, and others make it challenging to identify coronal holes using these automated schemes. While discrepancies between detection schemes have been noted in the literature, a comprehensive assessment of these discrepancies is still lacking. The contribution of the Coronal Hole Boundary Working Team in the COSPAR ISWAT initiative to close this gap is threefold. First, we present the first community data set for comparing automated coronal hole detection schemes. This data set consists of 29 SDO images, all of which were selected by experienced observers to challenge automated schemes. Second, we use this community data set as input to 14 widely applied automated schemes to study coronal holes and collect their detection results. Third, we study three SDO images from the data set that exemplify the most important lessons learned from this effort. Our findings show that the choice of the automated detection scheme can have a significant effect on the physical properties of coronal holes, and we discuss the implications of these findings for open questions in solar and heliospheric physics. We envision that this community data set will serve the scientific community as a benchmark data set for future developments in the field.