Skip to yearly menu bar Skip to main content


Accelerating ReLU for MPC-Based Private Inference with a Communication-Efficient Sign Estimation

Kiwan Maeng · G. Edward Suh

Poster Position Number 20
[ ]
Tue 14 May 4:30 p.m. PDT — 4:50 p.m. PDT

Abstract: Secure multi-party computation (MPC) allows users to offload machine learning inference on untrusted servers without having to share their privacy-sensitive data. Despite their strong security properties, MPC-based private inference has not been widely adopted due to their high communication overhead, mostly incurred when evaluating non-linear layers.This paper presents HummingBird, an MPC framework that reduces the ReLU communication overhead significantly. HummingBird leverages an insight that determining whether a value is positive or negative mostly does not need a full-bit communication.With its theoretical analyses and an efficient search engine, HummingBird discards 66--72% of the bits during ReLU without altering the outcome, and discards 87--91% when some accuracy can be degraded. On a realistic MPC setup, HummingBird achieves on average 2.03--2.67$\times$ end-to-end speedup without introducing any errors, and up to 8.42$\times$ when some accuracy degradation is tolerated.

Chat is not available.