Invited Talks
Kunle Olukotun

This talk is about the virtuous interplay between machine learning (ML) and systems. I will show examples of how systems optimized for ML computation can be used to train more accurate and capable ML models and how these ML models can be used to improve upon the ad-hoc heuristics used in system design and management. These improved systems can then be used to train better ML models. The latest trend in ML is the development of Foundation models. Foundation models are large pretrained models that have obtained state-of-the-art quality in natural language processing, vision, speech, and other areas. These models are challenging to train and serve because they are characterized by billions of parameters, irregular data access (sparsity) and irregular control flow. I will explain how Reconfigurable Dataflow Accelerators (RDAs) can be designed to accelerate foundation models with these characteristics. SambaNova Systems is using RDA technology to achieve record-setting performance on foundation models. I will describe how the RDAs can also be used to build Taurus, an intelligent network data plane that enables ML models to be used to manage computer networks at full line-rate bandwidths. In particular, a Taurus prototype detects two orders of magnitude more events in a …

Dawn Song

Data is a key driver of modern economy and AI/machine learning, however, a lot of this data is sensitive and handling the sensitive data has caused unprecedented challenges for both individuals and businesses, and these challenges will only get more severe as we move forward in the digital era. In this talk, I will talk about technologies needed for responsible data use including secure computing, differential privacy, federated learning, as well as blockchain technologies for data rights, and how to combine privacy computing technologies and blockchain to building a platform for a responsible data economy, to enable the creation of a new type of asset, i.e., data assets, more responsible use of data and fair distribution of value created from data.

Ryan Adams

Advances in machine learning are having exciting impacts in a variety of domains from neuroscience to chemistry to astronomy. Machine learning has been somewhat slow to interface with more traditional engineering domains such as mechanical, civil, and chemical engineering. Nevertheless, there is huge potential for ML to accelerate everything in the engineering design cycle: CAD, simulation, fabrication, and control. In this talk I will discuss some of the exciting work starting to happen at this interface—from deep generative modeling to differentiable physical simulation---and take a look forward at what might be possible.

Ryan Adams is a machine learning researcher and Professor of Computer Science at Princeton University. Ryan completed his Ph.D. in physics under David MacKay at the University of Cambridge, where he was a Gates Cambridge Scholar and a member of St. John's College. Following his Ph.D. Ryan spent two years as a Junior Research Fellow at the University of Toronto as a part of the Canadian Institute for Advanced Research. From 2011-2016, he was an Assistant Professor at Harvard University in the School of Engineering and Applied Sciences. In 2015, Ryan sold the company he co-founded, Whetlab, to Twitter and he spent three years in industry at Twitter …