SC25 Home
Close

Session

Paper
: Machine Learning: Inference and Serving
Session Chair
Murali Emani
Argonne National Laboratory (ANL)
Event Type
Paper
TimeThursday, 20 November 202510:30am - 12:00pm CST
Location261-262-265-266
Tags
HPC for Machine Learning
System Software and Cloud Computing
Recordings
Livestreamed
Recorded
Registration Categories
TP
Similar Sessions
Machine Learning: Training at Scale 2
System Software and Cloud
Graph Neural Networks and Training
Presentations
10:30am - 10:52am CSTMaverIQ: Fingerprint-Guided Extrapolation and Fragmentation-Aware Layering for Intent-Based LLM Serving
Authors
Dimitrios Liakopoulos
Prasoon Sinha
Tianrui Hu
Myungjin Lee
Neeraja J. Yadwadkar
System Software and Cloud Computing
10:52am - 11:15am CSTCompile-Time QoS Scheme for Deep Learning Inferences
Authors
Sungin Hong
Hyunjun Kim
Hwansoo Han
HPC for Machine Learning
11:15am - 11:37am CSTHetis: Serving LLMs in Heterogeneous GPU Clusters with Fine-Grained and Dynamic Parallelism
Authors
Zizhao Mo
Jianxiong Liao
Huanle Xu
Zhi Zhou
ChengZhong Xu
HPC for Machine Learning
11:37am - 12:00pm CSTgLLM: Global Balanced Pipeline Parallelism Systems for Distributed LLMs Serving with Token Throttling
Authors
Tianyu Guo
Xianwei Zhang
Jiangsu Du
Zhiguang Chen
Nong Xiao
Yutong Lu
HPC for Machine Learning