A new technical paper titled “Bringing uncertainty quantification to the extreme-edge with memristor-based Bayesian neural networks” was published by researchers at Université Grenoble Alpes, CEA, LETI, and CNRS.
Abstract:
“Safety-critical sensory applications, like medical diagnosis, demand accurate decisions from limited, noisy data. Bayesian neural networks excel at such tasks, offering predictive uncertainty assessment. However, because of their probabilistic nature, they are computationally intensive. An innovative solution utilizes memristors’ inherent probabilistic nature to implement Bayesian neural networks. However, when using memristors, statistical effects follow the laws of device physics, whereas in Bayesian neural networks, those effects can take arbitrary shapes. This work overcome this difficulty by adopting a variational inference training augmented by a “technological loss”, incorporating memristor physics. This technique enabled programming a Bayesian neural network on 75 crossbar arrays of 1,024 memristors, incorporating CMOS periphery for in-memory computing. The experimental neural network classified heartbeats with high accuracy, and estimated the certainty of its predictions. The results reveal orders-of-magnitude improvement in inference energy efficiency compared to a microcontroller or an embedded graphics processing unit performing the same task.”
Find the technical paper here. Published November 2023.
Bonnet, D., Hirtzlin, T., Majumdar, A. et al. Bringing uncertainty quantification to the extreme-edge with memristor-based Bayesian neural networks. Nat Commun 14, 7530 (2023). https://doi.org/10.1038/s41467-023-43317-9
Related
Modeling Compute In Memory With Biological Efficiency
Generative AI forces chipmakers to use compute resources more intelligently.
Leave a Reply