Diversified learning for continuous hidden Markov models with application to fault diagnosis

• Published in: Expert systems with applications Vol. 42; no. 23; pp. 9165 - 9173
• Main Authors: Li, Zefang, Fang, Huajing, Huang, Ming
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 15.12.2015
• Subjects: Algorithms; Approximation; Bearing; Continuous hidden Markov models; Diversified gradient descent algorithm; Expert systems; Fault diagnosis; Learning; Likelihood-based model averaging; Mathematical models; Parameter estimation; Fault diagnosis; Diversified gradient descent algorithm; Likelihood-based model averaging; Continuous hidden Markov models
• ISSN: 0957-4174; 1873-6793
• DOI: 10.1016/j.eswa.2015.08.027

•The diversified learning formulas of CHMM parameters are derived.•A likelihood-based model averaging estimator is developed.•Bearing fault diagnosis is effectively performed. The learning problem of continuous hidden Markov models (CHMMs) is the most critical and challenging one for the application of CHMMs. This paper aims to attack the learning problem of CHMMs by using the diversified gradient descent (DGD) algorithm. The novel learning formula of CHMM parameters, requiring no special form of the objective function and yielding various parameter estimates with different degree of diversity, is derived through dynamically adjusting the iterative procedure according to the gradient change of each parameter. It is the first work for standard CHMM attempting to obtain more local maxima so that the global maximum of the likelihood function of CHMM can be better approximated or even discovered. Hence this paper takes an important step forward in solving the learning problem of CHMM. Furthermore, a likelihood-based model averaging (LBMA) estimator is developed to achieve robust parameter estimation of CHMM based upon the diversiform models attained by the DGD algorithm. The proposed methods are tested on simulation and real-life bearing fault diagnosis problem. The results show that proposed methods perform better in parameter estimation and bearing fault diagnosis compared to the conventional methods.