Enabling standardized behavior for ML operations with TOSA (Eric Kunze, Arm)

Deploying ML models on edge devices poses a big challenge, as capabilities and numeric behavior can differ on each device. We will discuss the development of the Tensor Operator Set Architecture (TOSA), a set of base operators that serve as the building blocks for complex operations. TOSA operators define the functional and numeric behavior, ensuring that deployed networks behave consistently across a variety of devices.

Biography Eric Kunze is a Senior Principal Engineer in the ML Technology group at Arm, leading a group investigating future ML solutions.