(46 events)   Timezone: »  
Toggle Poster Visibility
Poster
None
Unified Convolution Framework: A compiler-based approach to support sparse convolutions
Jaeyeon Won · Changwan Hong · Charith Mendis · Joel Emer · Saman Amarasinghe
Poster
None
Efficient GPU Kernels for N:M-Sparse Weights in Deep Learning
Bin Lin · Ningxin Zheng · · Shijie Cao · Lingxiao Ma · Quanlu Zhang · Yi Zhu · Ting Cao · Jilong Xue · Yuqing Yang · Fan Yang
Poster
None
GiPH: Generalizable Placement Learning for Adaptive Heterogeneous Computing
Yi Hu · Chaoran Zhang · Edward Andert · Harshul Singh · Aviral Shrivastava · James Laudon · Yanqi Zhou · Bob Iannucci · Carlee Joe-Wong
Poster
None
Be Careful with PyPI Packages: You May Unconsciously Spread Backdoor Model Weights
· Hao Lan · Baochun Li
Poster
None
HyperGef: A Framework Enabling Efficient Fusion for Hypergraph Neural Network on GPUs
Zhongming Yu · Guohao Dai · Shang Yang · Genghan Zhang · Hengrui Zhang · Feiwen Zhu · June Yang · Jishen Zhao · Yu Wang
Poster
None
SUBGRAPH STATIONARY HARDWARE-SOFTWARE INFERENCE CO-DESIGN
Payman Behnam · Alexey Tumanov · Tushar Krishna · Pranav Gadikar · Yangyu Chen · Jianming Tong · Yue Pan · Abhimanyu Rajeshkumar Bambhaniya · Alind Khare
Poster
None
GlueFL: Reconciling Client Sampling and Model Masking for Bandwidth Efficient Federated Learning
Shiqi He · Qifan Yan · Feijie Wu · Lanjun Wang · Mathias Lécuyer · Ivan Beschastnikh
Poster
None
Pre-trained Neural Cost Models for Efficient Embedding Table Sharding in Deep Learning Recommendation Models
Daochen Zha · Louis Feng · Liang Luo · Bhargav Bhushanam · Zirui Liu · Yusuo Hu · Jade Nie · Yuzhen Huang · Yuandong Tian · Arun Kejariwal · Xia Hu
Poster
None
Sirius: Harvesting Whole-Program Optimization Opportunities for DNNs
YIJIN LI · Jiacheng Zhao · Sun Qianqi · Haohui Mai · Lei Chen · Wanlu Cao · Yanfan Chen · Li zhicheng · YING LIU · Xinyuan Zhang · Xiyu Shi · Jie Zhao · Jingling Xue · HUIMIN CUI · XiaoBing Feng
Poster
None
DISTRIBUTED DEEP LEARNING BUILT ON TENSOR-OPTIMIZED REMOTE PROCEDURE CALLS
Pritam Damania · Shen Li · Alban Desmaison · Alisson Azzolini · Brian Vaughan · Edward Yang · Gregory Chanan · Guoqiang Jerry Chen · Hongyi Jia · · Joseph Spisak · Luca Wehrstedt · Lucas Hosseini · Manoj Krishnan · Omkar Salpekar · Pavel Belevich · Rohan Varma · Satendra Gera · Wanchao Liang · Shihao Xu · Soumith Chintala · Chaoyang He · Amir Ziashahabi · Salman Avestimehr · · Zachary DeVito
Poster
None
XRBench: An Extended Reality (XR) Machine Learning Benchmark Suite for the Metaverse
Hyoukjun Kwon · Krishnakumar Nair · Jamin Seo · Jason Yik · Debabrata Mohapatra · Dongyuan Zhan · JINOOK SONG · Peter Capak · Peizhao Zhang · Peter Vajda · Colby Banbury · Mark Mazumder · Liangzhen Lai · Ashish Sirasao · Tushar Krishna · Harshit Khaitan · Vikas Chandra · Vijay Janapa Reddi
Poster
None
FedTree: A Federated Learning System For Trees
Qinbin Li · Zhaomin Wu · Yanzheng Cai · yuxuan han · Ching Man Yung · Tianyuan Fu · Bingsheng He
Poster
None
Building Verified Neural Networks for Computer Systems with Ouroboros
Cheng Tan · Changliu Liu · Zhihao Jia · Tianhao Wei
Poster
None
Practical Edge Kernels for Integer-Only Vision Transformers Under Post-training Quantization
Zining Zhang · Bingsheng He · Zhenjie Zhang
Poster
None
On Optimizing the Communication of Model Parallelism
Yonghao Zhuang · · Lianmin Zheng · Zhuohan Li · Eric Xing · Qirong Ho · Joseph Gonzalez · Ion Stoica · Hao Zhang
Poster
None
Exploiting Hardware Utilization and Adaptive Dataflow for Efficient Sparse Convolution in 3D Point Clouds
· Zhongming Yu · Guohao Dai · Xinhao Yang · yaoxiu lian · 泽浩 刘 · Ningyi Xu · Yu Wang
Poster
None
AutoScratch: ML-Optimized GPU Cache Management
Yaosheng Fu · Evgeny Bolotin · Aamer Jaleel · Gal Dalal · Shie Mannor · Jacob Subag · Noam Korem · Michael Behar · David Nellans
Poster
None
μ-TWO: MULTI-MODEL TRAINING WITH ORCHESTRATION AND MEMORY OPTIMIZATION
Sanket Purandare · Wasay Abdul · Stratos Idreos ·
Poster
None
ALCOP: Automatic Load-Compute Pipelining in Deep Learning Compiler for AI-GPUs
Guyue Huang · · Liu Liu · Yuke Wang · Bei Yu · Yufei Ding · Yuan Xie
Poster
None
Sparsity-Aware Memory Interface Architecture using Stacked XORNet Compression for Accelerating Pruned-DNN Models
Younghoon Byun · Seungsik Moon · Baeseong Park · Se Jung Kwon · Dongsoo Lee · Gunho Park · EUNJI YOO · Jung Gyu Min · Youngjoo Lee
Poster
None
Safe Optimized Static Memory Allocation for Parallel Deep Learning
Ioannis Lamprou · Zhen ZHANG · Javier de Juan · hang yang · Yongqiang Lai · Etienne Filhol · Cedric Bastoul
Poster
None
Flex: Adaptive Mixture-of-Experts at Scale
Changho Hwang · Wei Cui · Yifan Xiong · Ziyue Yang · Ze Liu · Han Hu · Zilong Wang · Rafael Salas · Jithin Jose · Prabhat Ram · HoYuen Chau · Peng Cheng · Fan Yang · Mao Yang · Yongqiang Xiong
Poster
None
Virtual Machine Allocation with Lifetime Predictions
Hugo Barbalho · Patricia Kovaleski · Beibin Li · Luke Marshall · Marco Molinaro · Abhisek Pan · Eli Cortez · Matheus Leao · Harsh Patwari · Zuzu Tang · Larissa Rozales Gonçalves · David Dion · Thomas Moscibroda · Ishai Menache
Poster
None
Hotline Profiler: Automatic Annotation and A Multi-Scale Timeline for Visualizing Time-Use in DNN Training
Daniel Snider · Fanny Chevalier · Gennady Pekhimenko
Poster
None
Renee: END-TO-END TRAINING OF EXTREME CLASSIFICATION MODELS
Vidit Jain · Jatin Prakash · Deepak Saini · Jian Jiao · Ramachandran Ramjee · Manik Varma
Poster
None
RecD: Deduplication for End-to-End Deep Learning Recommendation Model Training Infrastructure
Mark Zhao · Dhruv Choudhary · Devashish Tyagi · Ajay Somani · Max Kaplan · Sung-Han Lin · Sarunya Pumma · Jongsoo Park · Aarti Basant · Niket Agarwal · Carole-Jean Wu · Christos Kozyrakis
Poster
None
Transcending Runtime-Memory Tradeoffs in Checkpointing by being Fusion Aware
Horace He · Shangdi Yu
Poster
None
OptNNS: Optimising Transformation of Neural Network Subgraphs
Guoliang HE · Sean Parker · Eiko Yoneki
Poster
None
Cupcake: A Compression Scheduler for Scalable Communication-Efficient Distributed Training
Zhuang Wang · Xinyu Wu · Zhaozhuo Xu · T. S. Eugene Ng
Poster
None
Learning to Parallelize with OpenMP by Augmented Heterogeneous AST Representation
Le Chen · Quazi Ishtiaque Mahmud · Hung Phan · Nesreen Ahmed · Ali Jannesari
Poster
None
Efficient Training of Large Language Models Using Pipelining and Fisher Information Matrices
Kazuki Osawa · Shigang Li · Torsten Hoefler
Poster
None
FLINT: A Platform for Federated Learning Integration
Ewen Wang · Boyi Chen · Mosharaf Chowdhury · · Franco Liang
Poster
None
Edge Impulse: An MLOps Platform for Tiny Machine Learning
colby banbury · Vijay Janapa Reddi · Alexander Elium · · David Tischler · Daniel Situnayake · Carl Ward · Louis MOREAU · Jenny Plunkett · Matthew Kelcey · Mathijs Baaijens · Alessandro Grande · Dmitry Maslov · Arthur Beavis · Jan Jongboom · Jessica Quaye
Poster
None
On Noisy Evaluation in Federated Hyperparameter Tuning
Kevin Kuo · Pratiksha Thaker · Mikhail Khodak · John Nguyen · Daniel Jiang · Ameet Talwalkar · Virginia Smith
Poster
None
Adaptive Message Quantization and Parallelization for Distributed Full-graph GNN Training
Borui Wan · JUNTAO ZHAO · Chuan Wu
Poster
None
ApproxCaliper: A Programmable Framework for Application-aware Neural Network Optimization
Yifan Zhao · Hashim Sharif · Peter Pao-Huang · Vatsin Shah · Arun Narenthiran Sivakumar · Mateus Valverde Gasparino · Abdulrahman Mahmoud · Nathan Zhao · Sarita Adve · Girish Chowdhary · Sasa Misailovic ·
Poster
None
SysNoise: Exploring and Benchmarking Training-Deployment System Inconsistency
Yan Wang · Yuhang Li · Ruihao Gong · Aishan Liu · yanfei wang · 健 胡 · Yongqiang Yao · Yunchen Zhang · tianzi xiaotian · Fengwei Yu · Xianglong Liu
Poster
None
Cuttlefish: Low-rank Model Training without All The Tuning
Hongyi Wang · Saurabh Agarwal · Pongsakorn U-chupala · Yoshiki Tanaka · Eric Xing · Dimitris Papailiopoulos
Poster
None
Communication-Efficient Graph Neural Networks with Probabilistic Neighborhood Expansion Analysis and Caching
Tim Kaler · Alexandros-Stavros Iliopoulos · Philip Murzynowski · Tao Schardl · Charles E. Leiserson · Jie Chen
Poster
None
Breadth-First Pipeline Parallelism
Joel Lamy-Poirier
Poster
None
RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network
Vitaliy Chiley · Vithursan Thangarasa · Abhay Gupta · Anshul Samar · Joel Hestness · Dennis DeCoste
Poster
None
Efficiently Scaling Transformer Inference
Reiner Pope · Sholto Douglas · Aakanksha Chowdhery · Jacob Devlin · James Bradbury · Jonathan Heek · Kefan Xiao · Shivani Agrawal · Jeff Dean
Poster
None
Uniform Sparsity in Deep Neural Networks
Saurav Muralidharan
Poster
None
MegaBlocks: Efficient Sparse Training with Mixture-of-Experts
Trevor Gale · Deepak Narayanan · Cliff Young · Matei Zaharia
Poster
None
Reducing Activation Recomputation in Large Transformer Models
Vijay Anand Korthikanti · Jared Casper · Sangkug Lym · Lawrence McAfee · Michael Andersch · Mohammad Shoeybi · Bryan Catanzaro
Poster
None
Validating Large Language Models with ReLM
Michael Kuchnik · Virginia Smith · George Amvrosiadis