Skip to yearly menu bar Skip to main content


Timezone: US/Pacific
Full Schedule Mon Tue Wed Thu Fri
Filter Events
Registration Desk
8:00 AM - 5:00 PM
Oral
8:30 AM - 10:00 AM
5 Events in this session
Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding
Yilong Zhao ⋅ Jiaming Tang ⋅ Kan Zhu ⋅ Zihao Ye ⋅ Chi-Chih Chang ⋅ Chaofan Lin ⋅ Jongseok Park ⋅ Guangxuan Xiao ⋅ Mohamed Abdelfattah ⋅ Mingyu Gao ⋅ Baris Kasikci ⋅ Song Han ⋅ Ion Stoica
CDLM: CONSISTENCY DIFFUSION LANGUAGE MODELS FOR FASTER SAMPLING
Minseo Kim ⋅ Chenfeng Xu ⋅ Coleman Hooper ⋅ Harman Singh ⋅ Ben Athiwaratkun ⋅ Ce Zhang ⋅ Kurt Keutzer ⋅ Amir Gholami
PRISM: PARAMETRICALLY RESTRUCTURED INFERENCE FOR SPECULATIVE SAMPLING DRAFT MODELS
Xuliang Wang ⋅ Yuetao Chen ⋅ Maochan Zhen ⋅ Fang LIU ⋅ Xinzhou Zheng ⋅ Xingwu Liu ⋅ Hong Xu ⋅ Ming Li
SpecDiff-2: Scaling Diffusion Drafter Alignment For Faster Speculative Decoding
Jameson Sandler ⋅ Jacob K Christopher ⋅ ⋅ Ferdinando Fioretto
Speculative Decoding: Performance or Illusion?
Lily Liu ⋅ Jiaxiang Yu ⋅ Jongseok Park ⋅ Alvin Cheung ⋅ Ion Stoica
Go to Event Page
Oral
8:30 AM - 10:00 AM
5 Events in this session
ADS: AN AGENTIC DETECTION SYSTEM FOR ENTERPRISE AGENTIC AI SECURITY
Chenning Li ⋅ Pan Hu ⋅ Justin Xu ⋅ Baris Ozbas ⋅ Olivia Liu ⋅ Caroline Van ⋅ ⋅ Wei Zhou ⋅ Mohammad Alizadeh ⋅ Pengyu Zhang
Agentic Operator Generation for ML ASICs
Alec Hammond ⋅ Aram Markosyan ⋅ Aman Dontula ⋅ ⋅ Zacharias Fisches ⋅ Dmitrii Pedchenko ⋅ Keyur Muzumdar ⋅ ⋅ Mark Saroufim ⋅ Joe Isaacson ⋅ ⋅ Warren Hunt ⋅ ⋅ ⋅ Gabriel Synnaeve ⋅ ⋅ Jacob Kahn ⋅
Cost-aware Duration Prediction for Software Upgrades in Datacenters
Yi Ding ⋅ Henry (Hank) Hoffmann
PROMPTS: PeRformance Optimization via Multi-Agent Planning for LLM Training and Serving
Yuran Ding ⋅ Ruobing Han ⋅ Xiaofan Zhang ⋅ Xinwei Chen
The OpenHands Software Agent SDK: A Composable and Extensible Foundation for Production Agents
Xingyao Wang ⋅ ⋅ Juan Michelini ⋅ Calvin Smith ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ ⋅
Go to Event Page
Invited Talk

Keynote - Luke Zettlemoyer

Luke Zettlemoyer
10:30 AM - 11:30 AM
Speaker Bio
Luke Zettlemoyer
I am a Professor in the Paul G. Allen School of Computer Science & Engineering at the University of Washington, and a Senior Research Director at Meta. My research focuses on empirical methods for natural language semantics, and involves designing machine learning algorithms, introducing new tasks and datasets, analyzing model performance, and, most recently, studying how to best develop self-supervision signals for pre-training. My honors include being elected as ACL President (2024), named an ACL Fellow (2021), as well as winning a PECASE award (2016), an Allen Distinguished Investigator award (2014), and many best paper awards. I was an undergraduate at NC State, recieved my PhD from MIT, and was a postdocal researcher at the University of Edinburgh.
... more
Session
10:30 AM - 11:30 AM
Oral
1:00 PM - 2:30 PM
5 Events in this session
EarthSight: A Distributed Framework for Low-Latency Satellite Intelligence
Ansel Erol ⋅ Seungjun Lee ⋅ Divya Mahajan
IntAttention: A Fully Integer Attention Pipeline for Efficient Edge Inference
Wanli Zhong ⋅ Haibo Feng ⋅ Zirui Zhou ⋅ Hanyang Peng ⋅ Shiqi Yu
LEANN: A Low-Storage Overhead Vector Index
Yichuan Wang ⋅ Zhifei Li ⋅ Shu Liu ⋅ Yongji Wu ⋅ Ziming Mao ⋅ Yilong Zhao ⋅ Xiao Yan ⋅ Zhiying Xu ⋅ Yang Zhou ⋅ Ion Stoica ⋅ Sewon Min ⋅ Matei Zaharia ⋅ Joseph Gonzalez
REPARO: LOSS-RESILIENT GENERATIVE CODEC FOR VIDEO CONFERENCING
Tianhong Li ⋅ Vibhaalakshmi Sivaraman ⋅ Pantea Karimi ⋅ Lijie Fan ⋅ Mohammad Alizadeh ⋅ Dina Katabi
Rethinking DVFS for Mobile LLMs: Unified Energy-Aware Scheduling with CORE
Zongpu Zhang ⋅ ⋅ Y. Charlie Hu ⋅ Qiang Xu ⋅ Jian Li ⋅ Haibing Guan
Go to Event Page
Oral
1:00 PM - 2:30 PM
6 Events in this session
BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batching
Zhen Zheng ⋅ Xin Ji ⋅ Taosong Fang ⋅ Fanghao Zhou ⋅ Chuanjie Liu ⋅
Beyond the Buzz: A Pragmatic Take on Inference Disaggregation
Tiyasa Mitra ⋅ Ritika Borkar ⋅ Nidhi Bhatia ⋅ Shivam Raj ⋅ hongkuan zhou ⋅ Yan Ru Pei ⋅ ⋅ Kyle ⋅ Ramon Matas ⋅ Dheevatsa Mudigere ⋅ Ritchie Zhao ⋅ Maximilian Golub ⋅ Arpan Dutta ⋅ ⋅ Sailaja Madduri ⋅ Dharmesh Jani ⋅ Brian Pharris ⋅ Itay Neeman ⋅ Bita Darvish Rouhani
Meeting SLOs, Slashing Hours: Automated Enterprise LLM Optimization with OptiKIT
Nicholas Santavas ⋅ Kareem Eissa ⋅ ⋅ Piotr Florek ⋅ Matteo Nulli ⋅ Stefan Vasilev ⋅ Seyyed Hashemi ⋅ Antonios Gasteratos ⋅ Shahram Khadivi
Optimizing Deployment Configurations for LLM Inference
Sungmin Cho ⋅ Jaewon Lee ⋅ Chunqiang Tang ⋅ Yejin Lee ⋅ Geonhwa Jeong ⋅ ⋅ Scott Batura ⋅ ⋅ ⋅ ⋅ Sijia Chen ⋅ ⋅ Bradley Davis ⋅ Summer Deng ⋅ ⋅ Emad El-Haraty ⋅ ⋅ Lu Fang ⋅ Lu Fang ⋅ Joshua Fromm ⋅ ⋅ ⋅ Liangpeng Guo ⋅ ⋅ ⋅ Jianyu Huang ⋅ Aya Ibrahim ⋅ ⋅ Hongyi Jia ⋅ Changkyu Kim ⋅ ⋅ ⋅ ⋅ ⋅ Xiaozhu Meng ⋅ Vlad Tiberiu Mihailescu ⋅ ⋅ Maxim Naumov ⋅ Michal Ostrowski ⋅ ⋅ ⋅ Sarunya Pumma ⋅ ⋅ ⋅ Jeremy Francis Reizenstein ⋅ Rajasi Saha ⋅ ⋅ ⋅ Ruan Silva ⋅ ⋅ Jon Swenson ⋅ ⋅ Chris Thi ⋅ ⋅ Yunfan Wang ⋅ Pengchao Wang ⋅ Wenchen Wang ⋅ ⋅ Bram Wasti ⋅ ⋅ ⋅ Jingyi Yang ⋅ ⋅ ⋅ Jing Zhang ⋅ Yi Zhen ⋅
Scaling Up Large Language Models Serving Systems for Semantic Job Search
Kayhan Behdin ⋅ Qingquan Song ⋅ Sriram Vasudevan ⋅ Jian Sheng ⋅ Xiaojing Ma ⋅ Zhengze Zhou ⋅ Chuanrui Zhu ⋅ Guoyao Li ⋅ Chanh Nguyen ⋅ ⋅ Hejian Sang ⋅ Ata Fatahi ⋅ ⋅ Xiaoqing Wang ⋅ Qing Lan ⋅ ⋅ Qi Guo ⋅ Caleb Johnson ⋅ Zhipeng Wang ⋅
SHIP: SRAM-Based Huge Inference Pipelines for Fast LLM Serving
⋅ ⋅ ⋅ ⋅ ⋅ Sahil Parmar ⋅ ⋅ ⋅ ⋅ ⋅
Go to Event Page
Oral
2:45 PM - 4:15 PM
5 Events in this session
Charon: A Unified and Fine-Grained Simulator for Large-Scale LLM Training and Inference
Mengtian Yang ⋅ Zhekun Zhang ⋅ Mingheng Wu ⋅ jianwen yan ⋅ Hanshi Sun ⋅ Li-Wen Chang
DriftBench: Measuring and Predicting Infrastructure Drift in LLM Serving Systems
Gianluigi Vitale
Hawkeye: Reproducing GPU-Level Non-Determinism
⋅ Dan Boneh ⋅ Ilan Komargodski ⋅ Megha Srivastava
Massive-Scale Out-Of-Core UMAP on the GPU
Jinsol Park ⋅ Corey Nolet ⋅ Edward Raff ⋅ Tim Oates ⋅ Akira Naruse
Parrot: Persuasion and Agreement Robustness Rating of Output Truth
Yusuf Çelebi ⋅ Mahmoud ElHussieni ⋅ Özay Ezerceli
Go to Event Page
Oral
2:45 PM - 4:15 PM
6 Events in this session
AXLearn: Modular, Hardware-Agnostic Large Model Training
Mark Lee ⋅ Tom Gunter ⋅ Chang Lan ⋅ ⋅ Hanzhi Zhou ⋅ ⋅ Sneha Bangalore ⋅ ⋅ ⋅ Xianzhi Du ⋅ Philipp Dufter ⋅ ⋅ Ruixuan Hou ⋅ Haoshuo Huang ⋅ ⋅ Xiang Kong ⋅ Jinhao Lei ⋅ Tao Lei ⋅ Meng Li ⋅ Li Li ⋅ Jiarui Lu ⋅ Zhiyun Lu ⋅ ⋅ ⋅ ⋅ ⋅ Zhucheng Tu ⋅ Chong Wang ⋅ Jianyu Wang ⋅ ⋅ Zirui Wang ⋅ ⋅ Sam Wiseman ⋅ Guoli Yin ⋅ ⋅ Xiyou Zhou ⋅ Danyang Zhuo ⋅ ⋅ Ruoming Pang
FlexScale: Flexible and High-Performance FSDP at Scale
Zezhou Wang ⋅ Youjie Li ⋅ Zhiqi Lin ⋅ Jiacheng Yang ⋅ Cong Xie ⋅ ⋅ ZHENG ZHONG ⋅ ⋅ Hongyu Zhu ⋅ Zhi Zhang ⋅ Xin Liu ⋅ Yanghua Peng
FreeScale: Distributed Training for Sequence Recommendation Models with Minimal Scaling Cost
Chenhao Feng ⋅ Haoli Zhang ⋅ Shakhzod Ali-zade ⋅ Yanli Zhao ⋅ Liang Luo ⋅ Jennifer Cao ⋅ Lisen Deng ⋅ ⋅ Chenyu Zhao ⋅ ⋅ ⋅ ⋅ Tiantu Xu ⋅ Yi Zhang ⋅ Evgenii Kolpakov ⋅ Siqi Yan ⋅ Chuanhao Zhuge ⋅ Min Ni ⋅ Bi Xue ⋅ Qunshu Zhang ⋅ Shen Li
MoEBlaze: Breaking the Memory Wall for Efficient MoE Training on Modern GPUs
Jiyuan Zhang ⋅ Yining Liu ⋅ Siqi Yan ⋅ Lisen Deng ⋅ Jennifer Cao ⋅ Shuqi Yang ⋅ Bi Xue ⋅ Min Ni ⋅ Shen Li
NodeSweep: Practical Straggler Detection and Health Monitoring for Large-Scale Foundation Model Training
Guanliang Liu ⋅ Zoe Zeng ⋅ ⋅ Cong Cheng ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ Alexander Zhipa ⋅ Ashvin Nihalani ⋅ Binxuan Huang ⋅ ⋅
Sparing Strategies to Minimize Reliability Impact On Large Training Jobs
⋅ ⋅ Ehsan K. Ardestani ⋅ ⋅ ⋅ ⋅ Zhaodong Wang ⋅ ⋅ Xu Zhang ⋅ ⋅ Ying Zhang
Go to Event Page
Oral
4:30 PM - 6:00 PM
6 Events in this session
AIRS: Scaling Live Inference in Resource Constrained Environments
Nilesh Jagnik ⋅ ⋅ ⋅ ⋅ Harshvardhan GM
MLCommons Chakra: Advancing Performance Benchmarking and Co-design using Standardized Execution Traces
Srinivas ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ Hanjiang Wu ⋅ Changhai Man ⋅ Jinsun Yoo ⋅ Huan Xu ⋅ William Won ⋅ ⋅ Winston Liu ⋅ Andrey Balogh ⋅ Dan Mihailescu ⋅ Brad B ⋅ Vinay Ramakrishnaiah ⋅ Spandan More ⋅ Saeed Rashidi ⋅ Louis Feng ⋅ Ashwin Ramachandran ⋅ Puneet Sharma ⋅ ⋅ Vijay Janapa Reddi ⋅ David Kanter ⋅ Tushar Krishna
ML Fleet Efficiency: Improving TPU Systems at Scale with ML Productivity Goodput
Arissa Wongpanich ⋅ Tayo Oguntebi ⋅ ⋅ Yu Wang ⋅ Phitchaya Phothilimthana ⋅ Ritwika Mitra ⋅ Zongwei Zhou ⋅ Naveen Kumar ⋅ Vijay Janapa Reddi
ProfInfer: An eBPF-based Fine-Grained LLM Inference Profiler
Bohua Zou ⋅ ⋅ ⋅ Weihao Xu ⋅ Binqi Sun ⋅ ⋅
SAKURAONE: An Open Ethernet–Based AI HPC System and Its Observed Workload Dynamics in a Single-Tenant LLM Development Environment
Fumikazu KONISHI ⋅ Yuuki Tsubouchi ⋅ Hirofumi Tsuruta
XProf: An Open, Scalable, and Extensible Profiling System for the Modern ML Stack
Clive Verghese ⋅ Prasanna Rengasamy ⋅ ⋅ Yin Zhang ⋅ Jiya Zhang ⋅ ⋅ Charles Alaras ⋅ Aditya Sharma ⋅ ⋅ ⋅ Rushabh Lalwani ⋅ Sannidhya Chauhan ⋅ Sai Ganesh Bandiatmakuri ⋅ ⋅ Ani Udipi ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ Naveen Kumar ⋅ ⋅ Sayce Falk ⋅ ⋅
Go to Event Page
Oral
4:30 PM - 6:00 PM
6 Events in this session
AccelOpt: A Self-Improving LLM Agentic System for AI Accelerator Kernel Optimization
Genghan Zhang ⋅ Shaowei Zhu ⋅ ⋅ ⋅ Allen Nie ⋅ Zhen Jia ⋅ Nandita Vijaykumar ⋅ Yida Wang ⋅ Kunle Olukotun
ApproxMLIR : Accuracy-Aware Compiler for Compound ML System
Hao Ren ⋅ Yi Mu ⋅ Sasa Misailovic
Event Tensor: A Unified Abstraction for Compiling Dynamic Megakernel
Hongyi Jin ⋅ Bohan Hou ⋅ Guanjie Wang ⋅ Ruihang Lai ⋅ Jinqi Chen ⋅ Zihao Ye ⋅ Yaxing Cai ⋅ Yixin Dong ⋅ Xinhao Cheng ⋅ Zhihao Zhang ⋅ Yilong Zhao ⋅ Yingyi Huang ⋅ Lijie Yang ⋅ Jinchen Jiang ⋅ Gabriele Oliaro ⋅ ⋅ Xupeng Miao ⋅ Vinod Grover ⋅ Todd Mowry ⋅ Zhihao Jia ⋅ Tianqi Chen
HipKittens: Fast and Furious AMD Kernels
William Hu ⋅ Drew Wadsworth ⋅ Sean Siddens ⋅ ⋅ Daniel Fu ⋅ ⋅ Muhammad Osama ⋅ Christopher Ré ⋅ Simran Arora
ParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels
Stuart H. Sul ⋅ Simran Arora ⋅ Benjamin Spector ⋅ Christopher Ré
SchedFlow: Transparent and Flexible Intra-Device Parallelism via Programmable Operator Scheduling
Yi Pan ⋅ Yile Gu ⋅ Luo Jinbin ⋅ Yibo Wu ⋅ Ziren Wang ⋅ ⋅ Ziyi Xu ⋅ Shengkai Lin ⋅ Stephanie Wang ⋅ Baris Kasikci
Go to Event Page
Poster
6:00 PM - 8:00 PM
54 Events in this session
Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding
Yilong Zhao ⋅ Jiaming Tang ⋅ Kan Zhu ⋅ Zihao Ye ⋅ Chi-Chih Chang ⋅ Chaofan Lin ⋅ Jongseok Park ⋅ Guangxuan Xiao ⋅ Mohamed Abdelfattah ⋅ Mingyu Gao ⋅ Baris Kasikci ⋅ Song Han ⋅ Ion Stoica
AccelOpt: A Self-Improving LLM Agentic System for AI Accelerator Kernel Optimization
Genghan Zhang ⋅ Shaowei Zhu ⋅ ⋅ ⋅ Allen Nie ⋅ Zhen Jia ⋅ Nandita Vijaykumar ⋅ Yida Wang ⋅ Kunle Olukotun
ADS: AN AGENTIC DETECTION SYSTEM FOR ENTERPRISE AGENTIC AI SECURITY
Chenning Li ⋅ Pan Hu ⋅ Justin Xu ⋅ Baris Ozbas ⋅ Olivia Liu ⋅ Caroline Van ⋅ ⋅ Wei Zhou ⋅ Mohammad Alizadeh ⋅ Pengyu Zhang
Agentic Operator Generation for ML ASICs
Alec Hammond ⋅ Aram Markosyan ⋅ Aman Dontula ⋅ ⋅ Zacharias Fisches ⋅ Dmitrii Pedchenko ⋅ Keyur Muzumdar ⋅ ⋅ Mark Saroufim ⋅ Joe Isaacson ⋅ ⋅ Warren Hunt ⋅ ⋅ ⋅ Gabriel Synnaeve ⋅ ⋅ Jacob Kahn ⋅
AIRS: Scaling Live Inference in Resource Constrained Environments
Nilesh Jagnik ⋅ ⋅ ⋅ ⋅ Harshvardhan GM
ApproxMLIR : Accuracy-Aware Compiler for Compound ML System
Hao Ren ⋅ Yi Mu ⋅ Sasa Misailovic
Attribution-based Sparse Activation in Large Language Models
Jifeng Song ⋅ Xiangyu Yin ⋅ Boyuan Yang ⋅ Kai Huang ⋅ Weichen Liu ⋅ Wei Gao
AXLearn: Modular, Hardware-Agnostic Large Model Training
Mark Lee ⋅ Tom Gunter ⋅ Chang Lan ⋅ ⋅ Hanzhi Zhou ⋅ ⋅ Sneha Bangalore ⋅ ⋅ ⋅ Xianzhi Du ⋅ Philipp Dufter ⋅ ⋅ Ruixuan Hou ⋅ Haoshuo Huang ⋅ ⋅ Xiang Kong ⋅ Jinhao Lei ⋅ Tao Lei ⋅ Meng Li ⋅ Li Li ⋅ Jiarui Lu ⋅ Zhiyun Lu ⋅ ⋅ ⋅ ⋅ ⋅ Zhucheng Tu ⋅ Chong Wang ⋅ Jianyu Wang ⋅ ⋅ Zirui Wang ⋅ ⋅ Sam Wiseman ⋅ Guoli Yin ⋅ ⋅ Xiyou Zhou ⋅ Danyang Zhuo ⋅ ⋅ Ruoming Pang
BatchLLM: Optimizing Large Batched LLM Inference with Global Prefix Sharing and Throughput-oriented Token Batching
Zhen Zheng ⋅ Xin Ji ⋅ Taosong Fang ⋅ Fanghao Zhou ⋅ Chuanjie Liu ⋅
Beyond the Buzz: A Pragmatic Take on Inference Disaggregation
Tiyasa Mitra ⋅ Ritika Borkar ⋅ Nidhi Bhatia ⋅ Shivam Raj ⋅ hongkuan zhou ⋅ Yan Ru Pei ⋅ ⋅ Kyle ⋅ Ramon Matas ⋅ Dheevatsa Mudigere ⋅ Ritchie Zhao ⋅ Maximilian Golub ⋅ Arpan Dutta ⋅ ⋅ Sailaja Madduri ⋅ Dharmesh Jani ⋅ Brian Pharris ⋅ Itay Neeman ⋅ Bita Darvish Rouhani
BLASST: Dynamic BLocked Attention Sparsity via Softmax Thresholding
Jiayi Yuan ⋅ Cameron Shinn ⋅ ⋅ Jingze Cui ⋅ George Klimiashvili ⋅ ⋅ Perkz Zheng ⋅ Bo Li ⋅ Zhou Yuxin ⋅ Zhouhai Ye ⋅ Weijie You ⋅ Richard Cai ⋅ Julien Demouth ⋅ John D. Owens ⋅ Xia Hu ⋅ ⋅ Timmy Liu ⋅ Huizi Mao
CATWILD: Compiler Autotuning for TPU workloads in the Wild
Ignacio Cano ⋅ Yu Wang ⋅ Phitchaya Phothilimthana ⋅ Mike Burrows ⋅ ⋅ Matheus Camargo ⋅ Alexander Wertheim ⋅ Chao Wang ⋅ David Liu ⋅ Tengyu Sun ⋅ Arissa Wongpanich ⋅ Christof Angermueller ⋅ ⋅ ⋅ Vineetha Govindaraj ⋅ Amit Sabne ⋅ ⋅ ⋅ Berkin Ilbeyi ⋅ Ryan Lefever ⋅ Mehrdad Khani ⋅ Subhankar Shah ⋅ Ankit Sinha ⋅ ⋅ ⋅ ⋅ Nikhil Sarda ⋅ ⋅ ⋅ ⋅ Emily Donahue ⋅ Sami Abu-El-Haija ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ Naveen Kumar
CDLM: CONSISTENCY DIFFUSION LANGUAGE MODELS FOR FASTER SAMPLING
Minseo Kim ⋅ Chenfeng Xu ⋅ Coleman Hooper ⋅ Harman Singh ⋅ Ben Athiwaratkun ⋅ Ce Zhang ⋅ Kurt Keutzer ⋅ Amir Gholami
Charon: A Unified and Fine-Grained Simulator for Large-Scale LLM Training and Inference
Mengtian Yang ⋅ Zhekun Zhang ⋅ Mingheng Wu ⋅ jianwen yan ⋅ Hanshi Sun ⋅ Li-Wen Chang
Cost-aware Duration Prediction for Software Upgrades in Datacenters
Yi Ding ⋅ Henry (Hank) Hoffmann
Dataflow Is All You Need
Darshan Gandhi ⋅ Pushkar Nandkar ⋅ David Koeplinger ⋅ ⋅ Romy Tsoupidi ⋅ ⋅ ⋅ Tuowen Zhao ⋅ Reid Goodbar ⋅ ⋅ Leon Zhang ⋅ ⋅ John Long ⋅ Han Wang ⋅ ⋅ ⋅ ⋅ Yun Du ⋅ Håkan Zeffer ⋅ ⋅ Raghu Prabhakar
DriftBench: Measuring and Predicting Infrastructure Drift in LLM Serving Systems
Gianluigi Vitale
EarthSight: A Distributed Framework for Low-Latency Satellite Intelligence
Ansel Erol ⋅ Seungjun Lee ⋅ Divya Mahajan
Efficient, VRAM-Constrained xLM Inference on Clients
Aditya Ukarande ⋅ Deep Shekhar ⋅ ⋅ Ram Rangan
Event Tensor: A Unified Abstraction for Compiling Dynamic Megakernel
Hongyi Jin ⋅ Bohan Hou ⋅ Guanjie Wang ⋅ Ruihang Lai ⋅ Jinqi Chen ⋅ Zihao Ye ⋅ Yaxing Cai ⋅ Yixin Dong ⋅ Xinhao Cheng ⋅ Zhihao Zhang ⋅ Yilong Zhao ⋅ Yingyi Huang ⋅ Lijie Yang ⋅ Jinchen Jiang ⋅ Gabriele Oliaro ⋅ ⋅ Xupeng Miao ⋅ Vinod Grover ⋅ Todd Mowry ⋅ Zhihao Jia ⋅ Tianqi Chen
ExecuTorch - A Unified PyTorch Solution to Run ML Models On-Device
Chen Lai ⋅ Cemal Bilgin ⋅ ⋅ Gregory Comer ⋅ ⋅ ⋅ ⋅ Lucy Qiu ⋅ Mengwei Liu ⋅ ⋅ Songhao Jia ⋅ ⋅ ⋅ Digant Desai ⋅ Hansong Zhang ⋅ Manuel Candales ⋅ Scott Roy ⋅ Sicheng Jia ⋅ Mergen Nachin ⋅ ⋅ Yanan Cao ⋅ ⋅ Shunting Zhang ⋅ ⋅ Angela Yi ⋅ Zhenrui Zhang ⋅ Andrew Or ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ Supriya Rao ⋅ ⋅ Soumith Chintala
FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scaling
Ted Zadouri ⋅ Markus Hoehnerbach ⋅ Jay Shah ⋅ ⋅
Flashlight: PyTorch Compiler Extensions to Accelerate Attention Variants
Bozhi You ⋅ Irene Wang ⋅ ⋅ Abhinav Jangda ⋅ Angélica Moreira ⋅ Roshan Dathathri ⋅ Divya Mahajan ⋅ Keshav Pingali
FlexScale: Flexible and High-Performance FSDP at Scale
Zezhou Wang ⋅ Youjie Li ⋅ Zhiqi Lin ⋅ Jiacheng Yang ⋅ Cong Xie ⋅ ⋅ ZHENG ZHONG ⋅ ⋅ Hongyu Zhu ⋅ Zhi Zhang ⋅ Xin Liu ⋅ Yanghua Peng
FreeScale: Distributed Training for Sequence Recommendation Models with Minimal Scaling Cost
Chenhao Feng ⋅ Haoli Zhang ⋅ Shakhzod Ali-zade ⋅ Yanli Zhao ⋅ Liang Luo ⋅ Jennifer Cao ⋅ Lisen Deng ⋅ ⋅ Chenyu Zhao ⋅ ⋅ ⋅ ⋅ Tiantu Xu ⋅ Yi Zhang ⋅ Evgenii Kolpakov ⋅ Siqi Yan ⋅ Chuanhao Zhuge ⋅ Min Ni ⋅ Bi Xue ⋅ Qunshu Zhang ⋅ Shen Li
Hawkeye: Reproducing GPU-Level Non-Determinism
⋅ Dan Boneh ⋅ Ilan Komargodski ⋅ Megha Srivastava
HipKittens: Fast and Furious AMD Kernels
William Hu ⋅ Drew Wadsworth ⋅ Sean Siddens ⋅ ⋅ Daniel Fu ⋅ ⋅ Muhammad Osama ⋅ Christopher Ré ⋅ Simran Arora
IntAttention: A Fully Integer Attention Pipeline for Efficient Edge Inference
Wanli Zhong ⋅ Haibo Feng ⋅ Zirui Zhou ⋅ Hanyang Peng ⋅ Shiqi Yu
LEANN: A Low-Storage Overhead Vector Index
Yichuan Wang ⋅ Zhifei Li ⋅ Shu Liu ⋅ Yongji Wu ⋅ Ziming Mao ⋅ Yilong Zhao ⋅ Xiao Yan ⋅ Zhiying Xu ⋅ Yang Zhou ⋅ Ion Stoica ⋅ Sewon Min ⋅ Matei Zaharia ⋅ Joseph Gonzalez
Massive-Scale Out-Of-Core UMAP on the GPU
Jinsol Park ⋅ Corey Nolet ⋅ Edward Raff ⋅ Tim Oates ⋅ Akira Naruse
Meeting SLOs, Slashing Hours: Automated Enterprise LLM Optimization with OptiKIT
Nicholas Santavas ⋅ Kareem Eissa ⋅ ⋅ Piotr Florek ⋅ Matteo Nulli ⋅ Stefan Vasilev ⋅ Seyyed Hashemi ⋅ Antonios Gasteratos ⋅ Shahram Khadivi
MLCommons Chakra: Advancing Performance Benchmarking and Co-design using Standardized Execution Traces
Srinivas ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ Hanjiang Wu ⋅ Changhai Man ⋅ Jinsun Yoo ⋅ Huan Xu ⋅ William Won ⋅ ⋅ Winston Liu ⋅ Andrey Balogh ⋅ Dan Mihailescu ⋅ Brad B ⋅ Vinay Ramakrishnaiah ⋅ Spandan More ⋅ Saeed Rashidi ⋅ Louis Feng ⋅ Ashwin Ramachandran ⋅ Puneet Sharma ⋅ ⋅ Vijay Janapa Reddi ⋅ David Kanter ⋅ Tushar Krishna
ML Fleet Efficiency: Improving TPU Systems at Scale with ML Productivity Goodput
Arissa Wongpanich ⋅ Tayo Oguntebi ⋅ ⋅ Yu Wang ⋅ Phitchaya Phothilimthana ⋅ Ritwika Mitra ⋅ Zongwei Zhou ⋅ Naveen Kumar ⋅ Vijay Janapa Reddi
MoEBlaze: Breaking the Memory Wall for Efficient MoE Training on Modern GPUs
Jiyuan Zhang ⋅ Yining Liu ⋅ Siqi Yan ⋅ Lisen Deng ⋅ Jennifer Cao ⋅ Shuqi Yang ⋅ Bi Xue ⋅ Min Ni ⋅ Shen Li
NodeSweep: Practical Straggler Detection and Health Monitoring for Large-Scale Foundation Model Training
Guanliang Liu ⋅ Zoe Zeng ⋅ ⋅ Cong Cheng ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ Alexander Zhipa ⋅ Ashvin Nihalani ⋅ Binxuan Huang ⋅ ⋅
Optimizing Deployment Configurations for LLM Inference
Sungmin Cho ⋅ Jaewon Lee ⋅ Chunqiang Tang ⋅ Yejin Lee ⋅ Geonhwa Jeong ⋅ ⋅ Scott Batura ⋅ ⋅ ⋅ ⋅ Sijia Chen ⋅ ⋅ Bradley Davis ⋅ Summer Deng ⋅ ⋅ Emad El-Haraty ⋅ ⋅ Lu Fang ⋅ Lu Fang ⋅ Joshua Fromm ⋅ ⋅ ⋅ Liangpeng Guo ⋅ ⋅ ⋅ Jianyu Huang ⋅ Aya Ibrahim ⋅ ⋅ Hongyi Jia ⋅ Changkyu Kim ⋅ ⋅ ⋅ ⋅ ⋅ Xiaozhu Meng ⋅ Vlad Tiberiu Mihailescu ⋅ ⋅ Maxim Naumov ⋅ Michal Ostrowski ⋅ ⋅ ⋅ Sarunya Pumma ⋅ ⋅ ⋅ Jeremy Francis Reizenstein ⋅ Rajasi Saha ⋅ ⋅ ⋅ Ruan Silva ⋅ ⋅ Jon Swenson ⋅ ⋅ Chris Thi ⋅ ⋅ Yunfan Wang ⋅ Pengchao Wang ⋅ Wenchen Wang ⋅ ⋅ Bram Wasti ⋅ ⋅ ⋅ Jingyi Yang ⋅ ⋅ ⋅ Jing Zhang ⋅ Yi Zhen ⋅
ParallelKittens: Systematic and Practical Simplification of Multi-GPU AI Kernels
Stuart H. Sul ⋅ Simran Arora ⋅ Benjamin Spector ⋅ Christopher Ré
Parrot: Persuasion and Agreement Robustness Rating of Output Truth
Yusuf Çelebi ⋅ Mahmoud ElHussieni ⋅ Özay Ezerceli
PRISM: PARAMETRICALLY RESTRUCTURED INFERENCE FOR SPECULATIVE SAMPLING DRAFT MODELS
Xuliang Wang ⋅ Yuetao Chen ⋅ Maochan Zhen ⋅ Fang LIU ⋅ Xinzhou Zheng ⋅ Xingwu Liu ⋅ Hong Xu ⋅ Ming Li
ProfInfer: An eBPF-based Fine-Grained LLM Inference Profiler
Bohua Zou ⋅ ⋅ ⋅ Weihao Xu ⋅ Binqi Sun ⋅ ⋅
PROMPTS: PeRformance Optimization via Multi-Agent Planning for LLM Training and Serving
Yuran Ding ⋅ Ruobing Han ⋅ Xiaofan Zhang ⋅ Xinwei Chen
REPARO: LOSS-RESILIENT GENERATIVE CODEC FOR VIDEO CONFERENCING
Tianhong Li ⋅ Vibhaalakshmi Sivaraman ⋅ Pantea Karimi ⋅ Lijie Fan ⋅ Mohammad Alizadeh ⋅ Dina Katabi
Rethinking DVFS for Mobile LLMs: Unified Energy-Aware Scheduling with CORE
Zongpu Zhang ⋅ ⋅ Y. Charlie Hu ⋅ Qiang Xu ⋅ Jian Li ⋅ Haibing Guan
SAKURAONE: An Open Ethernet–Based AI HPC System and Its Observed Workload Dynamics in a Single-Tenant LLM Development Environment
Fumikazu KONISHI ⋅ Yuuki Tsubouchi ⋅ Hirofumi Tsuruta
Scaling Up Large Language Models Serving Systems for Semantic Job Search
Kayhan Behdin ⋅ Qingquan Song ⋅ Sriram Vasudevan ⋅ Jian Sheng ⋅ Xiaojing Ma ⋅ Zhengze Zhou ⋅ Chuanrui Zhu ⋅ Guoyao Li ⋅ Chanh Nguyen ⋅ ⋅ Hejian Sang ⋅ Ata Fatahi ⋅ ⋅ Xiaoqing Wang ⋅ Qing Lan ⋅ ⋅ Qi Guo ⋅ Caleb Johnson ⋅ Zhipeng Wang ⋅
SchedFlow: Transparent and Flexible Intra-Device Parallelism via Programmable Operator Scheduling
Yi Pan ⋅ Yile Gu ⋅ Luo Jinbin ⋅ Yibo Wu ⋅ Ziren Wang ⋅ ⋅ Ziyi Xu ⋅ Shengkai Lin ⋅ Stephanie Wang ⋅ Baris Kasikci
SHIP: SRAM-Based Huge Inference Pipelines for Fast LLM Serving
⋅ ⋅ ⋅ ⋅ ⋅ Sahil Parmar ⋅ ⋅ ⋅ ⋅ ⋅
Sparing Strategies to Minimize Reliability Impact On Large Training Jobs
⋅ ⋅ Ehsan K. Ardestani ⋅ ⋅ ⋅ ⋅ Zhaodong Wang ⋅ ⋅ Xu Zhang ⋅ ⋅ Ying Zhang
SpecDiff-2: Scaling Diffusion Drafter Alignment For Faster Speculative Decoding
Jameson Sandler ⋅ Jacob K Christopher ⋅ ⋅ Ferdinando Fioretto
Speculative Decoding: Performance or Illusion?
Lily Liu ⋅ Jiaxiang Yu ⋅ Jongseok Park ⋅ Alvin Cheung ⋅ Ion Stoica
Spira: Exploiting Voxel Data Structural Properties for Efficient Sparse Convolution in Point Cloud Networks
Dionysios Adamopoulos ⋅ ⋅ Georgios Goumas ⋅ Christina Giannoula
The OpenHands Software Agent SDK: A Composable and Extensible Foundation for Production Agents
Xingyao Wang ⋅ ⋅ Juan Michelini ⋅ Calvin Smith ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ ⋅
WAVE: A SYMBOLIC PYTHON DSL AND COMPILER FOR HIGH PERFORMANCE MACHINE LEARNING
Harsh Menon ⋅ ⋅ Gaurav Verma ⋅ Martin P. Lücke ⋅ ⋅ ⋅ Nithin Meganathan ⋅ Sanket Pandit ⋅ William Gallard Hatch ⋅ ⋅ ⋅ Sahil FAIZAL ⋅ ⋅
XProf: An Open, Scalable, and Extensible Profiling System for the Modern ML Stack
Clive Verghese ⋅ Prasanna Rengasamy ⋅ ⋅ Yin Zhang ⋅ Jiya Zhang ⋅ ⋅ Charles Alaras ⋅ Aditya Sharma ⋅ ⋅ ⋅ Rushabh Lalwani ⋅ Sannidhya Chauhan ⋅ Sai Ganesh Bandiatmakuri ⋅ ⋅ Ani Udipi ⋅ ⋅ ⋅ ⋅ ⋅ ⋅ Naveen Kumar ⋅ ⋅ Sayce Falk ⋅ ⋅
Go to Event Page