Adaptive Friction in Deep Learning: Enhancing Optimizers with Sigmoid and Tanh Function - Zheng, Hongye; Wang, Bingxing; Xiao, Minheng; Qin, Honglin; Wu, Zhizhong; Tan, Lianghao (IEEE International Conference on Power, Intelligent Computing and Systems (Online), 2024)
Keywords: Accuracy; Adaptive Optimizers; component; Convergence; Deep learning; Friction; Friction Coefficient; Optimization; Oscillators; Refining; Residual neural networks; SigSignGrad; TanhSignGrad; Training; Trajectory