Structural plasticity‐based hydrogel optical Willshaw model for one‐shot on‐the‐fly edge learning

• Published in: InfoMat Vol. 5; no. 4
• Main Authors: Wang, Dingchen, Liu, Dingyao, Lin, Yinan, Yuan, Anran, Zhang, Woyu, Zhao, Yaping, Wang, Shaocong, Chen, Xi, Chen, Hegan, Zhang, Yi, Jiang, Yang, Shi, Shuhui, Loong, Kam Chi, Chen, Jia, Wei, Songrui, Wang, Qing, Yu, Hongyu, Xu, Renjing, Shang, Dashan, Zhang, Han, Zhang, Shiming, Wang, Zhongrui
• Format: Journal Article
• Language: English
• Published: Melbourne John Wiley & Sons, Inc 01.04.2023; Wiley
• Subjects: 3-D printers; Algorithms; Artificial intelligence; Associative memory; Biomimetics; Chemical reactions; Co-design; Configurations; Curing; Datasets; Deep learning; Digital computers; Energy efficiency; Evolution; Hardware; hydrogel; Hydrogels; Light; Machine learning; Microprocessors; Network latency; Neural networks; one‐shot learning; Optical communication; Optical memory (data storage); optical neural network; Optimization; Pattern classification; Plastic properties; Sensors; structural plasticity; Viscosity; Willshaw model
• ISSN: 2567-3165; 2770-5110; 2567-3165
• DOI: 10.1002/inf2.12399

Autonomous one‐shot on‐the‐fly learning copes with the high privacy, small dataset, and in‐stream data at the edge. Implementing such learning on digital hardware suffers from the well‐known von‐Neumann and scaling bottlenecks. The optical neural networks featuring large parallelism, low latency, and high efficiency offer a promising solution. However, ex‐situ training of conventional optical networks, where optical path configuration and deep learning model optimization are separated, incurs hardware, energy and time overheads, and defeats the advantages in edge learning. Here, we introduced a bio‐inspired material‐algorithm co‐design to construct a hydrogel‐based optical Willshaw model (HOWM), manifesting Hebbian‐rule‐based structural plasticity for simultaneous optical path configuration and deep learning model optimization thanks to the underlying opto‐chemical reactions. We first employed the HOWM as an all optical in‐sensor AI processor for one‐shot pattern classification, association and denoising. We then leveraged HOWM to function as a ternary content addressable memory (TCAM) of an optical memory augmented neural network (MANN) for one‐shot learning the Omniglot dataset. The HOWM empowered one‐shot on‐the‐fly edge learning leads to 1000× boost of energy efficiency and 10× boost of speed, which paves the way for the next‐generation autonomous, efficient, and affordable smart edge systems. Biological synapses of human brain undergo a period of overproduction after birth, which is followed by consolidating part of the synapses and pruning the rest, bearing great significance to the development of intelligence as shown in Figure A. Such structural plasticity inspires a material‐algorithm co‐design, a hydrogel‐based optical Willshaw model (HOWM) in Figure B, thanks to the underlying opto‐chemical reactions of hydrogel shown in Figure C. The HOWM empowers one‐shot on‐the‐fly learning and leads to 1000× boost of energy efficiency and 10× boost of speed, which may pave the way for the next‐generation autonomous, efficient and affordable smart edge systems.