A Comparison of CPU and GPU Implementations for the LHCb Experiment Run 3 Trigger

The LHCb Collaboration

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

The Large Hadron Collider beauty (LHCb) experiment at CERN is undergoing an upgrade in preparation for the Run 3 data collection period at the Large Hadron Collider (LHC). As part of this upgrade, the trigger is moving to a full software implementation operating at the LHC bunch crossing rate. We present an evaluation of a CPU-based and a GPU-based implementation of the first stage of the high-level trigger. After a detailed comparison, both options are found to be viable. This document summarizes the performance and implementation details of these options, the outcome of which has led to the choice of the GPU-based implementation as the baseline.

Original languageEnglish
Article number1
Pages (from-to)1-20
Number of pages20
JournalComputing and Software for Big Science
Volume6
Issue number1
Early online date22 Dec 2022
DOIs
Publication statusPublished - Dec 2022

Bibliographical note

Funding Information:
We thank the technical and administrative staff at the LHCb institutes. We acknowledge support from CERN and from the national agencies: CAPES, CNPq, FAPERJ and FINEP (Brazil); MOST and NSFC (China); CNRS/IN2P3 (France); BMBF, DFG and MPG (Germany); INFN (Italy); NWO (Netherlands); MEiN and NCN UMO-2018/31/B/ST2/03998 (Poland); MEN/IFA (Romania); MSHE (Russia); MICINN (Spain); SNSF and SER (Switzerland); NASU (Ukraine); STFC (United Kingdom); DOE NP and NSF (USA). We acknowledge the computing resources that are provided by CERN, IN2P3 (France), KIT and DESY (Germany), INFN (Italy), SURF (Netherlands), PIC (Spain), GridPP (United Kingdom), RRCKI and Yandex LLC (Russia), CSCS (Switzerland), IFIN-HH (Romania), CBPF (Brazil), PL-GRID (Poland) and NERSC (USA). We are indebted to the communities behind the multiple open-source software packages on which we depend. Individual groups or members have received support from ARC and ARDC (Australia); AvH Foundation (Germany); EPLANET, Marie Skłodowska-Curie Actions and ERC (European Union); A*MIDEX, ANR, IPhU and Labex P2IO, and Région Auvergne-Rhône-Alpes (France); Key Research Program of Frontier Sciences of CAS, CAS PIFI, CAS CCEPP, Fundamental Research Funds for the Central Universities, and Sci. & Tech. Program of Guangzhou (China); RFBR, RSF and Yandex LLC (Russia); GVA, XuntaGal and GENCAT (Spain); the Leverhulme Trust, the Royal Society and UKRI (United Kingdom). The authors would like to thank the LHCb computing and simulation teams for their support and for producing the simulated LHCb samples used to benchmark the performance of RTA software.

Funding Information:
We thank the technical and administrative staff at the LHCb institutes. We acknowledge support from CERN and from the national agencies: CAPES, CNPq, FAPERJ and FINEP (Brazil); MOST and NSFC (China); CNRS/IN2P3 (France); BMBF, DFG and MPG (Germany); INFN (Italy); NWO (Netherlands); MEiN and NCN UMO-2018/31/B/ST2/03998 (Poland); MEN/IFA (Romania); MSHE (Russia); MICINN (Spain); SNSF and SER (Switzerland); NASU (Ukraine); STFC (United Kingdom); DOE NP and NSF (USA). We acknowledge the computing resources that are provided by CERN, IN2P3 (France), KIT and DESY (Germany), INFN (Italy), SURF (Netherlands), PIC (Spain), GridPP (United Kingdom), RRCKI and Yandex LLC (Russia), CSCS (Switzerland), IFIN-HH (Romania), CBPF (Brazil), PL-GRID (Poland) and NERSC (USA). We are indebted to the communities behind the multiple open-source software packages on which we depend. Individual groups or members have received support from ARC and ARDC (Australia); AvH Foundation (Germany); EPLANET, Marie Sk?odowska-Curie Actions and ERC (European Union); A*MIDEX, ANR, IPhU and Labex P2IO, and R?gion Auvergne-Rh?ne-Alpes (France); Key Research Program of Frontier Sciences of CAS, CAS PIFI, CAS CCEPP, Fundamental Research Funds for the Central Universities, and Sci. & Tech. Program of Guangzhou (China); RFBR, RSF and Yandex LLC (Russia); GVA, XuntaGal and GENCAT (Spain); the Leverhulme Trust, the Royal Society and UKRI (United Kingdom). The authors would like to thank the LHCb computing and simulation teams for their support and for producing the simulated LHCb samples used to benchmark the performance of RTA software.

Publisher Copyright:
© 2021, The Author(s).

Funding

We thank the technical and administrative staff at the LHCb institutes. We acknowledge support from CERN and from the national agencies: CAPES, CNPq, FAPERJ and FINEP (Brazil); MOST and NSFC (China); CNRS/IN2P3 (France); BMBF, DFG and MPG (Germany); INFN (Italy); NWO (Netherlands); MEiN and NCN UMO-2018/31/B/ST2/03998 (Poland); MEN/IFA (Romania); MSHE (Russia); MICINN (Spain); SNSF and SER (Switzerland); NASU (Ukraine); STFC (United Kingdom); DOE NP and NSF (USA). We acknowledge the computing resources that are provided by CERN, IN2P3 (France), KIT and DESY (Germany), INFN (Italy), SURF (Netherlands), PIC (Spain), GridPP (United Kingdom), RRCKI and Yandex LLC (Russia), CSCS (Switzerland), IFIN-HH (Romania), CBPF (Brazil), PL-GRID (Poland) and NERSC (USA). We are indebted to the communities behind the multiple open-source software packages on which we depend. Individual groups or members have received support from ARC and ARDC (Australia); AvH Foundation (Germany); EPLANET, Marie Skłodowska-Curie Actions and ERC (European Union); A*MIDEX, ANR, IPhU and Labex P2IO, and Région Auvergne-Rhône-Alpes (France); Key Research Program of Frontier Sciences of CAS, CAS PIFI, CAS CCEPP, Fundamental Research Funds for the Central Universities, and Sci. & Tech. Program of Guangzhou (China); RFBR, RSF and Yandex LLC (Russia); GVA, XuntaGal and GENCAT (Spain); the Leverhulme Trust, the Royal Society and UKRI (United Kingdom). The authors would like to thank the LHCb computing and simulation teams for their support and for producing the simulated LHCb samples used to benchmark the performance of RTA software. We thank the technical and administrative staff at the LHCb institutes. We acknowledge support from CERN and from the national agencies: CAPES, CNPq, FAPERJ and FINEP (Brazil); MOST and NSFC (China); CNRS/IN2P3 (France); BMBF, DFG and MPG (Germany); INFN (Italy); NWO (Netherlands); MEiN and NCN UMO-2018/31/B/ST2/03998 (Poland); MEN/IFA (Romania); MSHE (Russia); MICINN (Spain); SNSF and SER (Switzerland); NASU (Ukraine); STFC (United Kingdom); DOE NP and NSF (USA). We acknowledge the computing resources that are provided by CERN, IN2P3 (France), KIT and DESY (Germany), INFN (Italy), SURF (Netherlands), PIC (Spain), GridPP (United Kingdom), RRCKI and Yandex LLC (Russia), CSCS (Switzerland), IFIN-HH (Romania), CBPF (Brazil), PL-GRID (Poland) and NERSC (USA). We are indebted to the communities behind the multiple open-source software packages on which we depend. Individual groups or members have received support from ARC and ARDC (Australia); AvH Foundation (Germany); EPLANET, Marie Sk?odowska-Curie Actions and ERC (European Union); A*MIDEX, ANR, IPhU and Labex P2IO, and R?gion Auvergne-Rh?ne-Alpes (France); Key Research Program of Frontier Sciences of CAS, CAS PIFI, CAS CCEPP, Fundamental Research Funds for the Central Universities, and Sci. & Tech. Program of Guangzhou (China); RFBR, RSF and Yandex LLC (Russia); GVA, XuntaGal and GENCAT (Spain); the Leverhulme Trust, the Royal Society and UKRI (United Kingdom). The authors would like to thank the LHCb computing and simulation teams for their support and for producing the simulated LHCb samples used to benchmark the performance of RTA software.

FundersFunder number
ARDC
CAS CCEPP
EPLANET
GridPP
IFIN-HH
Key Research Program of Frontier Sciences of CAS
MSHE
PL-GRID
Program of Guangzhou
RRCKI
SURF
XuntaGal
Yandex LLC
National Science Foundation
U.S. Department of Energy
Alexander von Humboldt-Stiftung
Association pour la Recherche sur le Cancer
Automotive Research Center
Karlsruhe Institute of Technology
H2020 Marie Skłodowska-Curie Actions
CERN
UK Research and Innovation
National Energy Research Scientific Computing Center
Science and Technology Facilities Council
Leverhulme Trust
Royal Society
European Research Council
Deutsches Elektronen-Synchrotron
Deutsche Forschungsgemeinschaft
Agence Nationale de la Recherche
Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung
National Natural Science Foundation of China
Russian Foundation for Basic Research
Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
Bundesministerium für Bildung und Forschung
Chinese Academy of Sciences
Nederlandse Organisatie voor Wetenschappelijk Onderzoek
Generalitat Valenciana
Conselho Nacional de Desenvolvimento Científico e Tecnológico
Instituto Nazionale di Fisica Nucleare
Narodowe Centrum NaukiUMO-2018/31/B/ST2/03998
Narodowe Centrum Nauki
Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro
Ministry of Science and Technology, Taiwan
National Academy of Sciences of Ukraine
Centre National de la Recherche Scientifique
Financiadora de Estudos e Projetos
Ministerio de Ciencia e Innovación
Russian Science Foundation
Région Auvergne-Rhône-Alpes
Fundamental Research Funds for the Central Universities
Institut national de physique nucléaire et de physique des particules
Sociedad Española de Reumatología

    Keywords

    • Heterogeneous
    • High-level trigger
    • High-throughput
    • Parallel computing
    • Real-time
    • Software

    Fingerprint

    Dive into the research topics of 'A Comparison of CPU and GPU Implementations for the LHCb Experiment Run 3 Trigger'. Together they form a unique fingerprint.

    Cite this