Quaternionic Convolutional Neural Networks with Trainable Bessel Activation Functions

• Published in: Complex analysis and operator theory Vol. 17; no. 6; p. 82
• Main Author: Vieira, Nelson
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 01.09.2023; Springer Nature B.V
• Subjects: Analysis; Artificial intelligence; Artificial neural networks; Computer graphics; Computer vision; Feature extraction; Mathematics; Mathematics and Statistics; Neural networks; Operator Theory; Parameters; Robotics; Virtual reality; 33C10; Artificial neural networks and deep learning; Activation functions; Quaternionic convolutional neural networks; Parametric activation functions; 30G35; 68T07; 33C90; Bessel functions; 68Q32
• ISSN: 1661-8254; 1661-8262; 1661-8262
• DOI: 10.1007/s11785-023-01387-z

Quaternionic convolutional neural networks (QCNN) possess the ability to capture both external dependencies between neighboring features and internal latent dependencies within features of an input vector. In this study, we employ QCNN with activation functions based on Bessel-type functions with trainable parameters, for performing classification tasks. Our experimental results demonstrate that this activation function outperforms the traditional ReLU activation function. Throughout our simulations, we explore various network architectures. The use of activation functions with trainable parameters offers several advantages, including enhanced flexibility, adaptability, improved learning, customized model behavior, and automatic feature extraction.