Drishti VOL: The performance profiling and tracing HDF5 VOL connector – Jean Luca Bez, LBNL - HUG24

From the 2024 HDF5 User Group Meeting (#HUG24) held August 5-7, 2024 in Chicago, IL.

Drishti VOL: The performance profiling and tracing HDF5 VOL connector – Jean Luca Bez, Lawrence Berkeley National Laboratory

github.com/hpc-io/drishti

Drishti is an interactive I/O analysis framework that seeks to close the gap between trace collection, analysis, and tuning by detecting common root causes of I/O performance inefficiencies and providing actionable user recommendations. In this talk, we demonstrate how Drishti can combine different sources of metrics and traces to provide a deeper understanding of I/O problems. Considering HDF5-based applications, we proposed the Drishti passthrough VOL connector to trace relevant high-level HDF5 calls that can be easily combined with other sources of I/O metrics, such as Darshan traces, to provide a cross-layer analysis and enhance the insights. We discuss our motivation and design choices and demonstrate how this HDF5 connector can aid in pinpointing the root causes of I/O performance bottlenecks.

For more information on this conference including all sessions and slide decks, visit www.hdfgroup.org/hug/hug24/agenda To learn more about upcoming HUG events, please visit www.hdfgroup.org/hug