Timezone: »
With evolving system architectures, hardware and software stack, diverse machine learning workloads, and data, it is important to understand how these components interact with each other. Well-defined benchmarking procedures help evaluate and reason the performance gains with ML workload to system mapping.
Key problems that we seek to address are: (i) which representative ML benchmarks cater to workloads seen in industry, national labs, and interdisciplinary sciences; (ii) how to characterize the ML workloads based on their interaction with hardware; (iii) what novel aspects of hardware, such as heterogeneity in compute, memory, and bandwidth, will drive their adoption; (iv) performance modeling and projections to next-generation hardware.
The workshop will invite experts in these research areas to present recent work and potential directions to pursue. Accepted papers from a rigorous evaluation process will present state-of-the-art research efforts. We have also secured funding from MLCommonsTM to provide a best paper award for an outstanding submission. A panel discussion will foster an interactive platform for discussion between speakers and the audience.
Thu 8:00 a.m. - 8:10 a.m.
|
Opening Remarks
|
🔗 |
Thu 8:10 a.m. - 9:00 a.m.
|
Keynote Talk - Sophia Shao
(
Invited Talk
)
|
Sophia Shao 🔗 |
Thu 9:00 a.m. - 9:30 a.m.
|
FastML Science Benchmarks: Accelerating Real-Time Scientific Edge Computing
(
Talk
)
|
🔗 |
Thu 9:30 a.m. - 10:00 a.m.
|
MetaBench: Real-Time Multi-Modal Benchmark for Metaverse
(
Talk
)
|
Hyoukjun Kwon 🔗 |
Thu 10:00 a.m. - 10:30 a.m.
|
Break
|
🔗 |
Thu 10:30 a.m. - 11:10 a.m.
|
Invited Talk - John Owens
(
Invited Talk
)
|
John Owens 🔗 |
Thu 11:10 a.m. - 11:30 a.m.
|
Benchmarking and Accelerating Session-Based Recommendation Model on Heterogeneous Accelerators
(
Talk
)
|
Mayank Mishra 🔗 |
Thu 11:30 a.m. - 11:50 a.m.
|
Optimizing Data Collection in Deep Reinforcement Learning
(
Talk
)
|
James Gleeson 🔗 |
Thu 11:50 a.m. - 1:30 p.m.
|
Lunch
|
🔗 |
Thu 1:30 p.m. - 2:20 p.m.
|
Invited Talk - Venkatram Vishwanath
(
Invited Talk
)
|
Venkatram Vishwanath 🔗 |
Thu 2:20 p.m. - 2:40 p.m.
|
Open-Source FPGA-ML Co-Design for the MLPerf Tiny Benchmark
(
Invited Talk
)
|
🔗 |
Thu 2:40 p.m. - 3:00 p.m.
|
Operation-Level Performance Benchmarking of Graph Neural Networks for Scientific Applications
(
Talk
)
|
Ryien Hosseini 🔗 |
Thu 3:00 p.m. - 3:30 p.m.
|
Break
|
🔗 |
Thu 3:30 p.m. - 4:45 p.m.
|
Panel Discussion
|
🔗 |
Thu 4:45 p.m. - 5:00 p.m.
|
Best Paper Award and Wrap-Up
(
Awards
)
|
🔗 |
Author Information
Tom St John (Cruise)
Murali Emani (Argonne National Laboratory)
Murali Emani is an Assistant Computer Scientist in the Data Science group with the Argonne Leadership Computing Facility (ALCF) at Argonne National Laboratory. His research interests are at the intersection of systems and machine learning including Parallel programming models, Hardware accelerators for ML/DL, High Performance Computing, Scalable Machine Learning, Runtime Systems, Performance optimization, Emerging HPC architectures, Online Adaptation. Prior, he was a Postdoctoral Research Staff Member at Lawrence Livermore National Laboratory, US. Murali obtained his PhD and worked as a Research Associate at the Institute for Computing Systems Architecture at the School of Informatics, University of Edinburgh, UK. His research resulted in multiple publications at top conferences such as PACT, PLDI and granted patents. Murali served as technical program committee member for conferences including ICPP'19, CCGRID'19, PACT '18, CCGRID '18, ICPP '18. He chaired the first Birds-of-feather session on Machine Learning benchmarking on HPC systems at Supercomputing 2019.
More from the Same Authors
-
2022 Poster: MLPerf Mobile Inference Benchmark: An Industry-Standard Open-Source Machine Learning Benchmark for On-Device AI »
Vijay Janapa Reddi · David Kanter · Peter Mattson · Jared Duke · Thai Nguyen · Ramesh Chukka · Ken Shiring · Koan-Sin Tan · Mark Charlebois · William Chou · Mostafa El-Khamy · Jungwook Hong · Tom St John · Cindy Trinh · Michael Buch · Mark Mazumder · Relja Markovic · Thomas Atta · Fatih Cakir · Masoud Charkhabi · Xiaodong Chen · Cheng-Ming Chiang · Dave Dexter · Terry Heo · Guenther Schmuelling · Maryam Shabani · Dylan Zika -
2023 Workshop: Benchmarking Machine Learning Workloads on Emerging Hardware »
Tom St John · Murali Emani · Wenqian Dong -
2022 Oral: MLPerf Mobile Inference Benchmark: An Industry-Standard Open-Source Machine Learning Benchmark for On-Device AI »
Vijay Janapa Reddi · David Kanter · Peter Mattson · Jared Duke · Thai Nguyen · Ramesh Chukka · Ken Shiring · Koan-Sin Tan · Mark Charlebois · William Chou · Mostafa El-Khamy · Jungwook Hong · Tom St John · Cindy Trinh · Michael Buch · Mark Mazumder · Relja Markovic · Thomas Atta · Fatih Cakir · Masoud Charkhabi · Xiaodong Chen · Cheng-Ming Chiang · Dave Dexter · Terry Heo · Guenther Schmuelling · Maryam Shabani · Dylan Zika -
2021 : Conclusion - Murali Emani (ANL) »
Murali Emani -
2021 : Panel Session - Lizy John (UT Austin), David Kaeli (Northeastern University), Tushar Krishna (Georgia Tech), Peter Mattson (Google), Brian Van Essen (LLNL), Venkatram Vishwanath (ANL), Carole-Jean Wu (Facebook) »
Tom St John · LIZY JOHn · Tushar Krishna · Peter Mattson · Venkatram Vishwanath · Carole-Jean Wu · David Kaeli · Brian Van Essen -
2021 Workshop: Benchmarking Machine Learning Workloads on Emerging Hardware »
Tom St John · Murali Emani -
2021 : Introduction - Tom St. John (Cruise) »
Tom St John -
2020 Workshop: Benchmarking Machine Learning Workloads on Emerging Hardware »
Tom St John · Murali Emani -
2020 Oral: MLPerf Training Benchmark »
Peter Mattson · Christine Cheng · Gregory Diamos · Cody Coleman · Paulius Micikevicius · David Patterson · Hanlin Tang · Gu-Yeon Wei · Peter Bailis · Victor Bittorf · David Brooks · Dehao Chen · Debo Dutta · Udit Gupta · Kim Hazelwood · Andy Hock · Xinyuan Huang · Daniel Kang · David Kanter · Naveen Kumar · Jeffery Liao · Deepak Narayanan · Tayo Oguntebi · Gennady Pekhimenko · Lillian Pentecost · Vijay Janapa Reddi · Taylor Robie · Tom St John · Carole-Jean Wu · Lingjie Xu · Cliff Young · Matei Zaharia -
2020 Poster: MLPerf Training Benchmark »
Peter Mattson · Christine Cheng · Gregory Diamos · Cody Coleman · Paulius Micikevicius · David Patterson · Hanlin Tang · Gu-Yeon Wei · Peter Bailis · Victor Bittorf · David Brooks · Dehao Chen · Debo Dutta · Udit Gupta · Kim Hazelwood · Andy Hock · Xinyuan Huang · Daniel Kang · David Kanter · Naveen Kumar · Jeffery Liao · Deepak Narayanan · Tayo Oguntebi · Gennady Pekhimenko · Lillian Pentecost · Vijay Janapa Reddi · Taylor Robie · Tom St John · Carole-Jean Wu · Lingjie Xu · Cliff Young · Matei Zaharia