Adversarial autoencoder for visualization and classification of human activity: Application to a low-cost commercial force plate

• Published in: Journal of Biomechanics Vol. 103; p. 109684
• Main Authors: Hernandez, Vincent, Kulić, Dana, Venture, Gentiane
• Format: Journal Article
• Language: English
• Published: United States Elsevier Ltd 16.04.2020; Elsevier BV; Elsevier Limited
• Subjects: Adversarial autoencoder; Classification; Data visualization; Deep learning; Experiments; Force plates; Ground reaction force; Human Activities; Human activity recognition; Humans; Learning algorithms; Machine Learning; Patients; Principal components analysis; Rehabilitation; Representations; Scientific visualization; Self evaluation; Sensors; Visualization; Deep learning; Human activity recognition; Ground reaction force; Adversarial autoencoder; Machine learning
• ISSN: 0021-9290; 1873-2380; 1873-2380
• DOI: 10.1016/j.jbiomech.2020.109684

The ability to visualize and interpret high dimensional time-series data will be critical as wearable and other sensors are adopted in rehabilitation protocols. This study proposes a latent space representation of high dimensional time-series data for data visualization. For that purpose, a deep learning model called Adversarial AutoEncoder (AAE) is proposed to perform efficient data dimensionality reduction by considering unsupervised and semi-supervised adversarial training. Eighteen subjects were recruited for the experiment and performed two sets of exercises (upper and lower body) on the Wii Balance Board. Then, the accuracy of the latent space representation is evaluated on both sets of exercises separately. Data dimensionality reduction with conventional Machine Learning (ML) and supervised Deep Learning (DL) classification are also performed to compare the efficiency of AAE approaches. The results showed that AAE can outperform conventional ML approaches while providing close results to DL supervised classification. AAE approaches for data visualization are a promising approach to monitor the subject’s movements and detect adverse events or similarity with previous data, providing an intuitive way to monitor the patient’s progress and provide potential information for rehabilitation tracking.