Collaborative monitoring and visualization of HPC data

Roselyne Tchoua, Hasan Abbasi, Scott Klasky, Qing Liu, Norbert Podhorszki, David Pugmire, Yuan Tian, Matthew Wolf

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

As simulations begin to scale to extreme processor counts trying to understand the mysteries of the universe, collaboration becomes an essential piece of the scientists' daily life as they work to run, analyze, and process their data from these simulations. Most of the teams that we collaborate with work identically to the way they did in the past, without using effective collaborative tools to share their knowledge with their peers. Collaboration is usually an afterthought, and is often handled in an awkward setting. We believe the best way to introduce collaboration into areas that are resistant by nature is to embed into low level and hidden system components so that scientists collaborate without consciously putting in extra efforts. Based on this hypothesis, this paper presents our work in creating a collaborative system, which allows a diverse set of scientists to work together efficiently. Two of the main aspects of our system are in our use of provenance to associate files and its associated metadata with the information that domain experts are interested in, and an easy-to-use high-performance I/O system which automatically annotates the output file(s) with a unified schema. To accomplish our goals, we leverage an existing I/O framework, ADIOS and an existing web interface, eSiMon, and add new techniques and mechanism to efficiently bring together computation and visualization.

Original languageEnglish (US)
Title of host publicationProceedings of the 2012 International Conference on Collaboration Technologies and Systems, CTS 2012
Pages397-403
Number of pages7
DOIs
StatePublished - 2012
Externally publishedYes
Event2012 13th International Conference on Collaboration Technologies and Systems, CTS 2012 - Denver, CO, United States
Duration: May 21 2012May 25 2012

Publication series

NameProceedings of the 2012 International Conference on Collaboration Technologies and Systems, CTS 2012

Other

Other2012 13th International Conference on Collaboration Technologies and Systems, CTS 2012
CountryUnited States
CityDenver, CO
Period5/21/125/25/12

All Science Journal Classification (ASJC) codes

  • Control and Systems Engineering

Keywords

  • collaboration
  • data staging
  • monitoring
  • schema
  • simulation
  • visualization

Fingerprint Dive into the research topics of 'Collaborative monitoring and visualization of HPC data'. Together they form a unique fingerprint.

Cite this