Presentation
SIGN IN TO VIEW THIS PRESENTATION Sign In
Pushing the Limits of Cold Storage for Research Data With Elm: An Open-Source S3-to-Tape System
DescriptionThis presentation introduces Elm, Stanford Research Computing’s latest storage system designed to handle large-scale archiving of research data, up to hundreds of petabytes. With a strong focus on affordability and energy-efficiency, Elm combines several open-source technologies: MinIO for S3 compatibility and high-level data security through erasure coding, Lustre with built-in parallel hierarchical storage management (HSM), Phobos for modern tape management, and LTFS for easy access to tape data in a standardized format. Together, these elements create a seamless S3 experience for researchers, and offers them access to scalable cold storage for their archival needs. Elm opens new opportunities for data storage at Stanford and has the potential to be replicated at other research institutions.