Skip to yearly menu bar Skip to main content


(3 events)   Timezone:  
Show all
Toggle Poster Visibility
Poster
Ballroom B - Position 2
Tutel: Adaptive Mixture-of-Experts at Scale
In Parallel and Distributed Systems 1: Parallelism
Changho Hwang · Wei Cui · Yifan Xiong · Ziyue Yang · Ze Liu · Han Hu · Zilong Wang · Rafael Salas · Jithin Jose · Prabhat Ram · HoYuen Chau · Peng Cheng · Fan Yang · Mao Yang · Yongqiang Xiong
[ Paper]  [ Slides] 
Poster
Ballroom B - Position 3
Breadth-First Pipeline Parallelism
In Parallel and Distributed Systems 1: Parallelism
Joel Lamy-Poirier
[ Paper]  [ Slides]  [ Poster] 
Poster
Ballroom B - Position 1
PipeFisher: Efficient Training of Large Language Models Using Pipelining and Fisher Information Matrices
In Parallel and Distributed Systems 1: Parallelism
Kazuki Osawa · Shigang Li · Torsten Hoefler
[ Paper]  [ Slides]  [ Poster]