Researchers from Washington University in St. Louis present an adaptive synaptic array that can be used to improve the energy-efficiency of training machine learning (ML) systems
Abstract
“In this paper we present an adaptive synaptic array that can be used to improve the energy-efficiency of training machine learning (ML) systems. The synaptic array comprises of an ensemble of analog memory elements, each of which is a micro-scale dynamical system in its own right, storing information in its temporal state trajectory. The state trajectories are then modulated by a system level learning algorithm such that the ensemble trajectory is guided towards the optimal solution. We show that the extrinsic energy required for state trajectory modulation can be matched to the dynamics of neural network learning which leads to a significant reduction in energy-dissipated for memory updates during ML training. Thus, the proposed synapse array could have significant implications in addressing the energy-efficiency imbalance between the training and the inference phases observed in artificial intelligence (AI) systems.”
Find the open access technical paper here. Published 03-2022.
Mehta, D., Rahman, M., Aono, K. et al. An adaptive synaptic array using Fowler–Nordheim dynamic analog memory. Nat Commun 13, 1670 (2022). https://doi.org/10.1038/s41467-022-29320-6.
Visit Semiconductor Engineering’s Technical Paper library here and discover many more chip industry academic papers.
Leave a Reply