EUROPAR 2023  Minisymposium on ADAPTIVE HPC I/O SYSTEMS – ADAPIO

To be held in cooperation with EURO-PAR Conference 2023

DATE:  Monday, August 28th, 2023

Motivation and scope of the minisymposium:

The growing need to process extremely large data sets is one of the main drivers for building Exascale HPC systems. However, the flat storage hierarchies found in classic HPC architectures no longer satisfy the performance and cost requirements of data-processing applications. Emerging multi-tier storage hierarchies come with the potential to remove this barrier by deploying ad-hoc file systems for each application. The main topic area to be addressed in the ADAPIO workshop is how to create adaptive I/O systems through the creation of an active I/O stack that dynamically adjusts computation and storage requirements through intelligent coordination, malleability of computation and I/O, and the scheduling of storage resources along all levels of the storage hierarchy. Moreover, ADAPIO addresses the problem of co-designing applications and I/O.

Topics of interest include, but are not limited to:

  • System architecture considerations in designing adaptive I/O architectures.
  • Run-time techniques to provide malleable execution models for computation, communication, and I/O.
  • Computing and I/O scheduling algorithms providing malleability.
  • High-level parallel programming models providing I/O adaptivity.
  • Monitoring, tracing and modeling applications’ I/O behavior. Usage of AI and ML techniques to steer I/O adaptivity in systems and applications.
  • Ad-hoc storage systems and I/O scheduling techniques helping I/O malleability.
  • Experiences and use cases applying adaptive I/O systems to HPC applications.

The workshop will provide a lively discussion forum for researchers working in HPC and pursuing the concepts of and around adaptive I/O systems. We therefore expect that, e.g., application designers who want to enhance their HPC applications by adapting I/O systems can learn from systems architects and storage researchers on how to dynamically adapt and deploy storage systems during application runtime.

Workshop organizers:

Program:

Below you may find a proposed list of talks already confirmed for the minisymposium.

 

Monday, August 28th, 2023. Afternoon

  • 14:00.  Opening. Jesus Carretero.
  • 14:00-14:30. Jean Baptiste Besnard. PARATOOLS. France.
    • Title: “How dynamic workload may change HPC I/O for good”.
  • 14:30-15:00. Massimo Torquati. University of Pisa (CINI). Italy.
    • Title: “Extending I/O POSIX semantics for data-streaming in scientific workflows with CAPIO”.
  • 15:00-15:30. Taylan Özden & Felix Wolf. Technical University of Darmstadt. Germany.
    • Title: “ElastiSim: A Batch-System Simulator for Malleable Workloads”
  • 15:30-16:00 COFFEE BREAK
  • 16:00-16:30. Marc-André Vef. Johannes Gutenberg University Mainz. Germany.
    • Title: “Benefits of malleable ad hoc file systems for HPC applications”
  • 16:30-17:00. Raffaele Montela. University of Naples “Parthenope” – Consorzio Interuniversitario Nazionale per Informatica. Italy.
    • Title: “Computational malleability and environmental modeling: practice and experience”
  • 17:00-17:30. Yi Ju. Max Planck Computing and Data Facility.
    • Title: “Exploring in-situ techniques and resource allocation on Quantum ESPRESSO”
  • 17:30.   Closing.