TY - JOUR
T1 - Evolution of the ATLAS PanDA workload management system for exascale computational science
AU - Maeno, T.
AU - De, K.
AU - Klimentov, A.
AU - Nilsson, P.
AU - Oleynik, D.
AU - Panitkin, S.
AU - Petrosyan, A.
AU - Schovancova, J.
AU - Vaniachine, A.
AU - Wenaus, T.
AU - Yu, D.
PY - 2014
Y1 - 2014
N2 - An important foundation underlying the impressive success of data processing and analysis in the ATLAS experiment [1] at the LHC [2] is the Production and Distributed Analysis (PanDA) workload management system [3]. PanDA was designed specifically for ATLAS and proved to be highly successful in meeting all the distributed computing needs of the experiment. However, the core design of PanDA is not experiment specific. The PanDA workload management system is capable of meeting the needs of other data intensive scientific applications. Alpha-Magnetic Spectrometer [4], an astro-particle experiment on the International Space Station, and the Compact Muon Solenoid [5], an LHC experiment, have successfully evaluated PanDA and are pursuing its adoption. In this paper, a description of the new program of work to develop a generic version of PanDA will be given, as well as the progress in extending PanDA's capabilities to support supercomputers and clouds and to leverage intelligent networking. PanDA has demonstrated at a very large scale the value of automated dynamic brokering of diverse workloads across distributed computing resources. The next generation of PanDA will allow other data-intensive sciences and a wider exascale community employing a variety of computing platforms to benefit from ATLAS' experience and proven tools.
AB - An important foundation underlying the impressive success of data processing and analysis in the ATLAS experiment [1] at the LHC [2] is the Production and Distributed Analysis (PanDA) workload management system [3]. PanDA was designed specifically for ATLAS and proved to be highly successful in meeting all the distributed computing needs of the experiment. However, the core design of PanDA is not experiment specific. The PanDA workload management system is capable of meeting the needs of other data intensive scientific applications. Alpha-Magnetic Spectrometer [4], an astro-particle experiment on the International Space Station, and the Compact Muon Solenoid [5], an LHC experiment, have successfully evaluated PanDA and are pursuing its adoption. In this paper, a description of the new program of work to develop a generic version of PanDA will be given, as well as the progress in extending PanDA's capabilities to support supercomputers and clouds and to leverage intelligent networking. PanDA has demonstrated at a very large scale the value of automated dynamic brokering of diverse workloads across distributed computing resources. The next generation of PanDA will allow other data-intensive sciences and a wider exascale community employing a variety of computing platforms to benefit from ATLAS' experience and proven tools.
UR - http://www.scopus.com/inward/record.url?scp=84903472773&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84903472773&partnerID=8YFLogxK
U2 - 10.1088/1742-6596/513/3/032062
DO - 10.1088/1742-6596/513/3/032062
M3 - Conference article
AN - SCOPUS:84903472773
SN - 1742-6588
VL - 513
JO - Journal of Physics: Conference Series
JF - Journal of Physics: Conference Series
IS - TRACK 3
M1 - 032062
T2 - 20th International Conference on Computing in High Energy and Nuclear Physics, CHEP 2013
Y2 - 14 October 2013 through 18 October 2013
ER -