RAPIDO: a rejuvenating adaptive PID-type optimiser for deep neural networks - Kim, S; Park, D.J; Chang, D.E (Electronics letters, 2019)
Keywords: activation functions; deep learning; deep neural networks; gradient descent algorithm; gradient methods; hyperbolic tangent functions; Information and communications; learning (artificial intelligence); MNIST classification task; neural nets; optimisation; pattern classification; PID controller; quadratic objective function; RAPIDO; rejuvenating adaptive PID‐type optimiser; ReLU functions; sigmoid functions; three‐term control; activation functions; pattern classification; three-term control; PID controller; sigmoid functions; ReLU functions; gradient descent algorithm; hyperbolic tangent functions; rejuvenating adaptive PID-type optimiser; deep learning; optimisation; RAPIDO; MNIST classification task; quadratic objective function; learning (artificial intelligence); gradient methods; neural nets; deep neural networks