Evolution of the ATLAS PanDA workload management system for exascale computational science

T. Maeno, K. De, A. Klimentov, P. Nilsson, D. Oleynik, S. Panitkin, A. Petrosyan, J. Schovancova, A. Vaniachine, T. Wenaus, D. Yu

Research output: Contribution to journalConference articlepeer-review

32 Scopus citations

Abstract

An important foundation underlying the impressive success of data processing and analysis in the ATLAS experiment [1] at the LHC [2] is the Production and Distributed Analysis (PanDA) workload management system [3]. PanDA was designed specifically for ATLAS and proved to be highly successful in meeting all the distributed computing needs of the experiment. However, the core design of PanDA is not experiment specific. The PanDA workload management system is capable of meeting the needs of other data intensive scientific applications. Alpha-Magnetic Spectrometer [4], an astro-particle experiment on the International Space Station, and the Compact Muon Solenoid [5], an LHC experiment, have successfully evaluated PanDA and are pursuing its adoption. In this paper, a description of the new program of work to develop a generic version of PanDA will be given, as well as the progress in extending PanDA's capabilities to support supercomputers and clouds and to leverage intelligent networking. PanDA has demonstrated at a very large scale the value of automated dynamic brokering of diverse workloads across distributed computing resources. The next generation of PanDA will allow other data-intensive sciences and a wider exascale community employing a variety of computing platforms to benefit from ATLAS' experience and proven tools.

Original languageEnglish (US)
Article number032062
JournalJournal of Physics: Conference Series
Volume513
Issue numberTRACK 3
DOIs
StatePublished - 2014
Event20th International Conference on Computing in High Energy and Nuclear Physics, CHEP 2013 - Amsterdam, Netherlands
Duration: Oct 14 2013Oct 18 2013

All Science Journal Classification (ASJC) codes

  • Physics and Astronomy(all)

Fingerprint Dive into the research topics of 'Evolution of the ATLAS PanDA workload management system for exascale computational science'. Together they form a unique fingerprint.

Cite this