Presentation
SIGN IN TO VIEW THIS PRESENTATION Sign In
SmartIO: A Lightweight End-to-End Workflow for Runtime I/O Optimization of HPC Systems
DescriptionThe I/O subsystem is often a critical bottleneck in HPC systems, making its optimization crucial for performance. Existing efforts to optimize the I/O in HPC applications rely on approaches that are time consuming and resource intensive. This work introduces SmartIO, an end-to-end workflow to optimize the I/O performance of HPC systems at runtime without requiring prior model training, profiling, or parameter searches. SmartIO leverages context-free grammars to predict future I/O calls during the application runtime, learns key I/O characteristics from predicted calls, and proactively optimizes performance before those calls occur using a rules-based mapping engine. Our evaluation shows that SmartIO achieves up to ∼ 13× and ∼ 12× improvements in IOR read and write bandwidth, respectively, and delivers a ∼ 4× speedup in overall I/O bandwidth for Flash-X—all with negligible overhead. Compared to the state-of-the-art I/O optimization tools, SmartIO delivers comparable or better performance while drastically reducing the tuning cost.
Event Type
Workshop
TimeMonday, 17 November 202512:00pm - 12:30pm CST
Location230
Data Analytics
High Performance I/O, Storage, Archive, & File Systems
Storage
Livestreamed
Recorded
TP
W