Timezone: »
"With evolving system architectures, hardware and software stack, diverse machine learning workloads, and data, it is important to understand how these components interact with each other. Well-defined benchmarking procedures help evaluate and reason the performance gains with ML workload to system mapping.
Key problems that we seek to address are: (i) which representative ML benchmarks cater to workloads seen in industry, national labs, and interdisciplinary sciences; (ii) how to characterize the ML workloads based on their interaction with hardware; (iii) what novel aspects of hardware, such as heterogeneity in compute, memory, and bandwidth, will drive their adoption; (iv) performance modeling and projections to next-generation hardware.
The workshop will invite experts in these research areas to present recent work and potential directions to pursue. Accepted papers from a rigorous evaluation process will present state-of-the-art research efforts. A panel discussion will foster an interactive platform for discussion between speakers and the audience."
Fri 8:00 a.m. - 8:10 a.m.
|
Introduction - Tom St. John (Cruise)
(Introduction)
|
Tom St John 🔗 |
Fri 8:10 a.m. - 8:50 a.m.
|
"System-Level Design of Machine Learning Accelerators with the Open Source ESP Platform - Luca Carloni (Columbia)
(Invited Talk)
|
Luca Carloni 🔗 |
Fri 8:50 a.m. - 9:00 a.m.
|
Morning Break 1
(Break)
|
🔗 |
Fri 9:00 a.m. - 9:40 a.m.
|
"Designing and Optimizing AI Systems for Deep Learning Recommendation and Beyond" - Carole-Jean Wu (Facebook)
(Invited Talk)
|
Carole-Jean Wu 🔗 |
Fri 9:40 a.m. - 10:00 a.m.
|
Morning Break 2
(Break)
|
🔗 |
Fri 10:00 a.m. - 10:30 a.m.
|
"Being-Ahead: Benchmarking and Exploring Accelerators for Hardware-Efficient AI Deployment" - Xiaofan Zhang (UIUC)
(Paper)
|
Xiaofan Zhang 🔗 |
Fri 10:30 a.m. - 10:50 a.m.
|
"Benchmarking Machine Learning Inference in FPGA-Based Accelerated Space Applications" - Amir Raoofy (TU Munich)
(Paper)
|
AMIR RAOOFY 🔗 |
Fri 10:50 a.m. - 11:30 a.m.
|
"Machine Learning Tools: Skyline and RL-Scope" - Gennady Pekhimenko and James Gleeson (University of Toronto)
(Invited Talk)
|
Gennady Pekhimenko 🔗 |
Fri 11:30 a.m. - 1:30 p.m.
|
Lunch
(Break)
|
🔗 |
Fri 1:30 p.m. - 2:10 p.m.
|
"Benchmarking Scientific ML on Disaggregated Cognitive Simulation HPC Platforms" - Brian Van Essen (LLNL)
(Invited Talk)
|
Brian Van Essen 🔗 |
Fri 2:10 p.m. - 2:50 p.m.
|
"Challenges with Running DNN Workloads with Hardware Simulators" - David Kaeli (Northeastern University) and "GNNMark: a Benchmark for GNN Training" - Trinayan Baruah (Northeastern University)
(Invited Talk)
|
David Kaeli 🔗 |
Fri 2:50 p.m. - 3:20 p.m.
|
Afternoon Break
(Break)
|
🔗 |
Fri 3:20 p.m. - 4:50 p.m.
|
Panel Session - Lizy John (UT Austin), David Kaeli (Northeastern University), Tushar Krishna (Georgia Tech), Peter Mattson (Google), Brian Van Essen (LLNL), Venkatram Vishwanath (ANL), Carole-Jean Wu (Facebook)
(Discussion Panel)
|
Tom St John · LIZY JOHn · Tushar Krishna · Peter Mattson · Venkatram Vishwanath · Carole-Jean Wu · David Kaeli · Brian Van Essen 🔗 |
Fri 4:50 p.m. - 5:00 p.m.
|
Conclusion - Murali Emani (ANL)
(Conclusion)
|
Murali Emani 🔗 |
Author Information
Tom St John (Cruise)
Murali Emani (Argonne National Laboratory)
Murali Emani is an Assistant Computer Scientist in the Data Science group with the Argonne Leadership Computing Facility (ALCF) at Argonne National Laboratory. His research interests are at the intersection of systems and machine learning including Parallel programming models, Hardware accelerators for ML/DL, High Performance Computing, Scalable Machine Learning, Runtime Systems, Performance optimization, Emerging HPC architectures, Online Adaptation. Prior, he was a Postdoctoral Research Staff Member at Lawrence Livermore National Laboratory, US. Murali obtained his PhD and worked as a Research Associate at the Institute for Computing Systems Architecture at the School of Informatics, University of Edinburgh, UK. His research resulted in multiple publications at top conferences such as PACT, PLDI and granted patents. Murali served as technical program committee member for conferences including ICPP'19, CCGRID'19, PACT '18, CCGRID '18, ICPP '18. He chaired the first Birds-of-feather session on Machine Learning benchmarking on HPC systems at Supercomputing 2019.
More from the Same Authors
-
2022 Poster: MLPerf Mobile Inference Benchmark: An Industry-Standard Open-Source Machine Learning Benchmark for On-Device AI »
Vijay Janapa Reddi · David Kanter · Peter Mattson · Jared Duke · Thai Nguyen · Ramesh Chukka · Ken Shiring · Koan-Sin Tan · Mark Charlebois · William Chou · Mostafa El-Khamy · Jungwook Hong · Tom St John · Cindy Trinh · Michael Buch · Mark Mazumder · Relja Markovic · Thomas Atta · Fatih Cakir · Masoud Charkhabi · Xiaodong Chen · Cheng-Ming Chiang · Dave Dexter · Terry Heo · Guenther Schmuelling · Maryam Shabani · Dylan Zika -
2023 Workshop: Benchmarking Machine Learning Workloads on Emerging Hardware »
Tom St John · Murali Emani · Wenqian Dong -
2022 Workshop: Benchmarking Machine Learning Workloads on Emerging Hardware »
Tom St John · Murali Emani -
2022 Oral: MLPerf Mobile Inference Benchmark: An Industry-Standard Open-Source Machine Learning Benchmark for On-Device AI »
Vijay Janapa Reddi · David Kanter · Peter Mattson · Jared Duke · Thai Nguyen · Ramesh Chukka · Ken Shiring · Koan-Sin Tan · Mark Charlebois · William Chou · Mostafa El-Khamy · Jungwook Hong · Tom St John · Cindy Trinh · Michael Buch · Mark Mazumder · Relja Markovic · Thomas Atta · Fatih Cakir · Masoud Charkhabi · Xiaodong Chen · Cheng-Ming Chiang · Dave Dexter · Terry Heo · Guenther Schmuelling · Maryam Shabani · Dylan Zika -
2021 : Conclusion - Murali Emani (ANL) »
Murali Emani -
2021 : Panel Session - Lizy John (UT Austin), David Kaeli (Northeastern University), Tushar Krishna (Georgia Tech), Peter Mattson (Google), Brian Van Essen (LLNL), Venkatram Vishwanath (ANL), Carole-Jean Wu (Facebook) »
Tom St John · LIZY JOHn · Tushar Krishna · Peter Mattson · Venkatram Vishwanath · Carole-Jean Wu · David Kaeli · Brian Van Essen -
2021 : Introduction - Tom St. John (Cruise) »
Tom St John -
2020 Workshop: Benchmarking Machine Learning Workloads on Emerging Hardware »
Tom St John · Murali Emani -
2020 Oral: MLPerf Training Benchmark »
Peter Mattson · Christine Cheng · Gregory Diamos · Cody Coleman · Paulius Micikevicius · David Patterson · Hanlin Tang · Gu-Yeon Wei · Peter Bailis · Victor Bittorf · David Brooks · Dehao Chen · Debo Dutta · Udit Gupta · Kim Hazelwood · Andy Hock · Xinyuan Huang · Daniel Kang · David Kanter · Naveen Kumar · Jeffery Liao · Deepak Narayanan · Tayo Oguntebi · Gennady Pekhimenko · Lillian Pentecost · Vijay Janapa Reddi · Taylor Robie · Tom St John · Carole-Jean Wu · Lingjie Xu · Cliff Young · Matei Zaharia -
2020 Poster: MLPerf Training Benchmark »
Peter Mattson · Christine Cheng · Gregory Diamos · Cody Coleman · Paulius Micikevicius · David Patterson · Hanlin Tang · Gu-Yeon Wei · Peter Bailis · Victor Bittorf · David Brooks · Dehao Chen · Debo Dutta · Udit Gupta · Kim Hazelwood · Andy Hock · Xinyuan Huang · Daniel Kang · David Kanter · Naveen Kumar · Jeffery Liao · Deepak Narayanan · Tayo Oguntebi · Gennady Pekhimenko · Lillian Pentecost · Vijay Janapa Reddi · Taylor Robie · Tom St John · Carole-Jean Wu · Lingjie Xu · Cliff Young · Matei Zaharia