TY - GEN
T1 - Collaborative monitoring and visualization of HPC data
AU - Tchoua, Roselyne
AU - Abbasi, Hasan
AU - Klasky, Scott
AU - Liu, Qing
AU - Podhorszki, Norbert
AU - Pugmire, David
AU - Tian, Yuan
AU - Wolf, Matthew
N1 - Copyright:
Copyright 2012 Elsevier B.V., All rights reserved.
PY - 2012
Y1 - 2012
N2 - As simulations begin to scale to extreme processor counts trying to understand the mysteries of the universe, collaboration becomes an essential piece of the scientists' daily life as they work to run, analyze, and process their data from these simulations. Most of the teams that we collaborate with work identically to the way they did in the past, without using effective collaborative tools to share their knowledge with their peers. Collaboration is usually an afterthought, and is often handled in an awkward setting. We believe the best way to introduce collaboration into areas that are resistant by nature is to embed into low level and hidden system components so that scientists collaborate without consciously putting in extra efforts. Based on this hypothesis, this paper presents our work in creating a collaborative system, which allows a diverse set of scientists to work together efficiently. Two of the main aspects of our system are in our use of provenance to associate files and its associated metadata with the information that domain experts are interested in, and an easy-to-use high-performance I/O system which automatically annotates the output file(s) with a unified schema. To accomplish our goals, we leverage an existing I/O framework, ADIOS and an existing web interface, eSiMon, and add new techniques and mechanism to efficiently bring together computation and visualization.
AB - As simulations begin to scale to extreme processor counts trying to understand the mysteries of the universe, collaboration becomes an essential piece of the scientists' daily life as they work to run, analyze, and process their data from these simulations. Most of the teams that we collaborate with work identically to the way they did in the past, without using effective collaborative tools to share their knowledge with their peers. Collaboration is usually an afterthought, and is often handled in an awkward setting. We believe the best way to introduce collaboration into areas that are resistant by nature is to embed into low level and hidden system components so that scientists collaborate without consciously putting in extra efforts. Based on this hypothesis, this paper presents our work in creating a collaborative system, which allows a diverse set of scientists to work together efficiently. Two of the main aspects of our system are in our use of provenance to associate files and its associated metadata with the information that domain experts are interested in, and an easy-to-use high-performance I/O system which automatically annotates the output file(s) with a unified schema. To accomplish our goals, we leverage an existing I/O framework, ADIOS and an existing web interface, eSiMon, and add new techniques and mechanism to efficiently bring together computation and visualization.
KW - collaboration
KW - data staging
KW - monitoring
KW - schema
KW - simulation
KW - visualization
UR - http://www.scopus.com/inward/record.url?scp=84866918171&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84866918171&partnerID=8YFLogxK
U2 - 10.1109/CTS.2012.6261083
DO - 10.1109/CTS.2012.6261083
M3 - Conference contribution
AN - SCOPUS:84866918171
SN - 9781467313803
T3 - Proceedings of the 2012 International Conference on Collaboration Technologies and Systems, CTS 2012
SP - 397
EP - 403
BT - Proceedings of the 2012 International Conference on Collaboration Technologies and Systems, CTS 2012
T2 - 2012 13th International Conference on Collaboration Technologies and Systems, CTS 2012
Y2 - 21 May 2012 through 25 May 2012
ER -