Presentation
Between the NIC and a Hard Place: Evaluating 400 Gb/s Ethernet for HPC Data Transfers
DescriptionThe readiness of new 400Gbps Ethernet hardware was evaluated for potential production use in high performance computing (HPC) environments over a local area network (LAN) and a wide area network (WAN). The approach explored a range of data movement strategies, including parallelized transfer tools, in which warp-speed data transfer (WDT) yielded optimal results. Furthermore, communication protocols were tested, such as Transmission Control Protocol (TCP) and remote direct memory access (RDMA) over converged Ethernet (RoCE). Performance tests were conducted on bandwidth and latency to understand potential bottlenecks. Stress tests were run in Message Passing Interface (MPI) and other HPC-relevant environments. The research examined whether a 400Gbps pipeline can be saturated using current tools and methods, both locally and across geographically distributed environments. The findings provided recommendations for enhancing high-throughput data workflows in HPC settings.
Event Type
Research and ACM SRC Posters
TimeTuesday, 18 November 20258:00am - 5:00pm CST
LocationSecond Floor Atrium
Archive
view