Abstract
The Large Hadron Collider beauty (LHCb) experiment at CERN is undergoing an upgrade in preparation for the Run 3 data collection period at the Large Hadron Collider (LHC). As part of this upgrade, the trigger is moving to a full software implementation operating at the LHC bunch crossing rate. We present an evaluation of a CPU-based and a GPU-based implementation of the first stage of the high-level trigger. After a detailed comparison, both options are found to be viable. This document summarizes the performance and implementation details of these options, the outcome of which has led to the choice of the GPU-based implementation as the baseline.
Original language | English |
---|---|
Article number | 1 |
Pages (from-to) | 1-20 |
Number of pages | 20 |
Journal | Computing and Software for Big Science |
Volume | 6 |
Issue number | 1 |
Early online date | 22 Dec 2022 |
DOIs | |
Publication status | Published - Dec 2022 |
Bibliographical note
Funding Information:We thank the technical and administrative staff at the LHCb institutes. We acknowledge support from CERN and from the national agencies: CAPES, CNPq, FAPERJ and FINEP (Brazil); MOST and NSFC (China); CNRS/IN2P3 (France); BMBF, DFG and MPG (Germany); INFN (Italy); NWO (Netherlands); MEiN and NCN UMO-2018/31/B/ST2/03998 (Poland); MEN/IFA (Romania); MSHE (Russia); MICINN (Spain); SNSF and SER (Switzerland); NASU (Ukraine); STFC (United Kingdom); DOE NP and NSF (USA). We acknowledge the computing resources that are provided by CERN, IN2P3 (France), KIT and DESY (Germany), INFN (Italy), SURF (Netherlands), PIC (Spain), GridPP (United Kingdom), RRCKI and Yandex LLC (Russia), CSCS (Switzerland), IFIN-HH (Romania), CBPF (Brazil), PL-GRID (Poland) and NERSC (USA). We are indebted to the communities behind the multiple open-source software packages on which we depend. Individual groups or members have received support from ARC and ARDC (Australia); AvH Foundation (Germany); EPLANET, Marie Skłodowska-Curie Actions and ERC (European Union); A*MIDEX, ANR, IPhU and Labex P2IO, and Région Auvergne-Rhône-Alpes (France); Key Research Program of Frontier Sciences of CAS, CAS PIFI, CAS CCEPP, Fundamental Research Funds for the Central Universities, and Sci. & Tech. Program of Guangzhou (China); RFBR, RSF and Yandex LLC (Russia); GVA, XuntaGal and GENCAT (Spain); the Leverhulme Trust, the Royal Society and UKRI (United Kingdom). The authors would like to thank the LHCb computing and simulation teams for their support and for producing the simulated LHCb samples used to benchmark the performance of RTA software.
Funding Information:
We thank the technical and administrative staff at the LHCb institutes. We acknowledge support from CERN and from the national agencies: CAPES, CNPq, FAPERJ and FINEP (Brazil); MOST and NSFC (China); CNRS/IN2P3 (France); BMBF, DFG and MPG (Germany); INFN (Italy); NWO (Netherlands); MEiN and NCN UMO-2018/31/B/ST2/03998 (Poland); MEN/IFA (Romania); MSHE (Russia); MICINN (Spain); SNSF and SER (Switzerland); NASU (Ukraine); STFC (United Kingdom); DOE NP and NSF (USA). We acknowledge the computing resources that are provided by CERN, IN2P3 (France), KIT and DESY (Germany), INFN (Italy), SURF (Netherlands), PIC (Spain), GridPP (United Kingdom), RRCKI and Yandex LLC (Russia), CSCS (Switzerland), IFIN-HH (Romania), CBPF (Brazil), PL-GRID (Poland) and NERSC (USA). We are indebted to the communities behind the multiple open-source software packages on which we depend. Individual groups or members have received support from ARC and ARDC (Australia); AvH Foundation (Germany); EPLANET, Marie Sk?odowska-Curie Actions and ERC (European Union); A*MIDEX, ANR, IPhU and Labex P2IO, and R?gion Auvergne-Rh?ne-Alpes (France); Key Research Program of Frontier Sciences of CAS, CAS PIFI, CAS CCEPP, Fundamental Research Funds for the Central Universities, and Sci. & Tech. Program of Guangzhou (China); RFBR, RSF and Yandex LLC (Russia); GVA, XuntaGal and GENCAT (Spain); the Leverhulme Trust, the Royal Society and UKRI (United Kingdom). The authors would like to thank the LHCb computing and simulation teams for their support and for producing the simulated LHCb samples used to benchmark the performance of RTA software.
Publisher Copyright:
© 2021, The Author(s).
Funding
We thank the technical and administrative staff at the LHCb institutes. We acknowledge support from CERN and from the national agencies: CAPES, CNPq, FAPERJ and FINEP (Brazil); MOST and NSFC (China); CNRS/IN2P3 (France); BMBF, DFG and MPG (Germany); INFN (Italy); NWO (Netherlands); MEiN and NCN UMO-2018/31/B/ST2/03998 (Poland); MEN/IFA (Romania); MSHE (Russia); MICINN (Spain); SNSF and SER (Switzerland); NASU (Ukraine); STFC (United Kingdom); DOE NP and NSF (USA). We acknowledge the computing resources that are provided by CERN, IN2P3 (France), KIT and DESY (Germany), INFN (Italy), SURF (Netherlands), PIC (Spain), GridPP (United Kingdom), RRCKI and Yandex LLC (Russia), CSCS (Switzerland), IFIN-HH (Romania), CBPF (Brazil), PL-GRID (Poland) and NERSC (USA). We are indebted to the communities behind the multiple open-source software packages on which we depend. Individual groups or members have received support from ARC and ARDC (Australia); AvH Foundation (Germany); EPLANET, Marie Skłodowska-Curie Actions and ERC (European Union); A*MIDEX, ANR, IPhU and Labex P2IO, and Région Auvergne-Rhône-Alpes (France); Key Research Program of Frontier Sciences of CAS, CAS PIFI, CAS CCEPP, Fundamental Research Funds for the Central Universities, and Sci. & Tech. Program of Guangzhou (China); RFBR, RSF and Yandex LLC (Russia); GVA, XuntaGal and GENCAT (Spain); the Leverhulme Trust, the Royal Society and UKRI (United Kingdom). The authors would like to thank the LHCb computing and simulation teams for their support and for producing the simulated LHCb samples used to benchmark the performance of RTA software. We thank the technical and administrative staff at the LHCb institutes. We acknowledge support from CERN and from the national agencies: CAPES, CNPq, FAPERJ and FINEP (Brazil); MOST and NSFC (China); CNRS/IN2P3 (France); BMBF, DFG and MPG (Germany); INFN (Italy); NWO (Netherlands); MEiN and NCN UMO-2018/31/B/ST2/03998 (Poland); MEN/IFA (Romania); MSHE (Russia); MICINN (Spain); SNSF and SER (Switzerland); NASU (Ukraine); STFC (United Kingdom); DOE NP and NSF (USA). We acknowledge the computing resources that are provided by CERN, IN2P3 (France), KIT and DESY (Germany), INFN (Italy), SURF (Netherlands), PIC (Spain), GridPP (United Kingdom), RRCKI and Yandex LLC (Russia), CSCS (Switzerland), IFIN-HH (Romania), CBPF (Brazil), PL-GRID (Poland) and NERSC (USA). We are indebted to the communities behind the multiple open-source software packages on which we depend. Individual groups or members have received support from ARC and ARDC (Australia); AvH Foundation (Germany); EPLANET, Marie Sk?odowska-Curie Actions and ERC (European Union); A*MIDEX, ANR, IPhU and Labex P2IO, and R?gion Auvergne-Rh?ne-Alpes (France); Key Research Program of Frontier Sciences of CAS, CAS PIFI, CAS CCEPP, Fundamental Research Funds for the Central Universities, and Sci. & Tech. Program of Guangzhou (China); RFBR, RSF and Yandex LLC (Russia); GVA, XuntaGal and GENCAT (Spain); the Leverhulme Trust, the Royal Society and UKRI (United Kingdom). The authors would like to thank the LHCb computing and simulation teams for their support and for producing the simulated LHCb samples used to benchmark the performance of RTA software.
Funders | Funder number |
---|---|
ARDC | |
CAS CCEPP | |
EPLANET | |
GridPP | |
IFIN-HH | |
Key Research Program of Frontier Sciences of CAS | |
MSHE | |
PL-GRID | |
Program of Guangzhou | |
RRCKI | |
SURF | |
XuntaGal | |
Yandex LLC | |
National Science Foundation | |
U.S. Department of Energy | |
Alexander von Humboldt-Stiftung | |
Association pour la Recherche sur le Cancer | |
Automotive Research Center | |
Karlsruhe Institute of Technology | |
H2020 Marie Skłodowska-Curie Actions | |
CERN | |
UK Research and Innovation | |
National Energy Research Scientific Computing Center | |
Science and Technology Facilities Council | |
Leverhulme Trust | |
Royal Society | |
European Research Council | |
Deutsches Elektronen-Synchrotron | |
Deutsche Forschungsgemeinschaft | |
Agence Nationale de la Recherche | |
Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung | |
National Natural Science Foundation of China | |
Russian Foundation for Basic Research | |
Coordenação de Aperfeiçoamento de Pessoal de Nível Superior | |
Bundesministerium für Bildung und Forschung | |
Chinese Academy of Sciences | |
Nederlandse Organisatie voor Wetenschappelijk Onderzoek | |
Generalitat Valenciana | |
Conselho Nacional de Desenvolvimento Científico e Tecnológico | |
Instituto Nazionale di Fisica Nucleare | |
Narodowe Centrum Nauki | UMO-2018/31/B/ST2/03998 |
Narodowe Centrum Nauki | |
Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro | |
Ministry of Science and Technology, Taiwan | |
National Academy of Sciences of Ukraine | |
Centre National de la Recherche Scientifique | |
Financiadora de Estudos e Projetos | |
Ministerio de Ciencia e Innovación | |
Russian Science Foundation | |
Région Auvergne-Rhône-Alpes | |
Fundamental Research Funds for the Central Universities | |
Institut national de physique nucléaire et de physique des particules | |
Sociedad Española de Reumatología |
Keywords
- Heterogeneous
- High-level trigger
- High-throughput
- Parallel computing
- Real-time
- Software