Timezone: »

Sense & Sensitivities: The Path to General-Purpose Algorithmic Differentiation
Mike Innes

Mon Mar 04:30 PM -- 07:00 PM PST @ Ballroom A #21
We present Zygote, an algorithmic differentiation (AD) system for the Julia language. Zygote is designed to address the needs of both the machine learning and scientific computing communities, who have historically been siloed by their very different tools. As well as fostering increased collaboration between these communities, we wish to enable \textit{differentiable programming} ($\partial P$), in which arbitrary numerical programs can make use of gradient-based optimisation. We present and evaluate our proposed solutions to the performance/expressiveness tradeoffs in current systems, as well as our work applying AD to many common programming language features, which is applicable to work in other languages and systems.

Author Information

Mike Innes (Julia Computing)

Related Events (a corresponding poster, oral, or spotlight)