Skip to main navigation Skip to search Skip to main content

Framework for custom event sample augmentations for ATLAS analysis data

  • the ATLAS Computing Activity
  • Argonne National Laboratory
  • Simon Fraser University
  • University of Oslo
  • Max-Planck-Institut für Physik
  • Brookhaven National Laboratory
  • Iowa State University

Research output: Contribution to journalConference articlepeer-review

3 Scopus citations

Abstract

For HEP event processing, data is typically stored in column-wise synchronized containers, such as most prominently ROOT's TTree, which have been used for several decades to store by now over 1 exabyte. These containers can combine row-wise association capabilities needed by most HEP event processing frameworks (e.g. Athena for ATLAS) with column-wise storage, which typically results in better compression and more efficient support for many analysis use-cases. One disadvantage is that these containers, TTree in the HEP use-case, require to contain the same attributes for each entry/row (representing events), which can make extending the list of attributes very costly in storage, even if those are only required for a small subsample of events. Since the initial design, the ATLAS software framework features powerful navigational infrastructure to allow storing custom data extensions for subsamples of events in separate, but synchronized containers. This allows adding event augmentations to ATLAS standard data products (such as DAOD-PHYS or PHYSLITE) avoiding duplication of those core data products, while limiting their size increase. For this functionality, the framework does not rely on any associations made by the I/O technology (i.e. ROOT), however it supports TTree friends and builds the associated index to allow for analysis outside of the ATLAS framework. A prototype based on the Long-Lived Particle search is implemented and preliminary results with this prototype will be presented. At this point, augmented data are stored within the same file as the core data. Storing them in separate files will be investigated in future, as this could provide more flexibility, e.g. certain sites may only want a subset of several augmentations or augmentations can be archived to tape once their analysis is complete.

Original languageEnglish
Article number03016
JournalEPJ Web of Conferences
Volume295
DOIs
StatePublished - 6 May 2024
Externally publishedYes
Event26th International Conference on Computing in High Energy and Nuclear Physics, CHEP 2023 - Norfolk, United States
Duration: 8 May 202312 May 2023

Fingerprint

Dive into the research topics of 'Framework for custom event sample augmentations for ATLAS analysis data'. Together they form a unique fingerprint.

Cite this