Evaluation of the performance of accelerometer-based gait event detection algorithms in different real-world scenarios using the MAREA gait database

• Published in: Gait & posture Vol. 51; no. NA; pp. 84 - 90
• Main Authors: Khandelwal, Siddhartha, Wickström, Nicholas
• Format: Journal Article
• Language: English
• Published: England Elsevier B.V 01.01.2017
• Subjects: accelerometer; Accelerometry; Adult; Algorithms; Biomechanical Phenomena; Female; Foot - physiology; Gait; Gait database; gait dataset; gait event detection; Gait events; Heel Strike; Humans; inertial sensor; Inertial sensors; Male; Orthopedics; Reproducibility of Results; Signal Processing, Computer-Assisted; Toe Off; Walking; Inertial sensors; Heel-Strike; Toe-Off; Gait events; Gait database
• ISSN: 0966-6362; 1879-2219; 1879-2219
• DOI: 10.1016/j.gaitpost.2016.09.023

•A new database of gait in indoor and outdoor environments using accelerometers.•Evaluation of the robustness of state-of-the-art gait event detection algorithms.•Algorithmic performance is significantly decreased in outdoor walking and running.•Algorithms show better performance for detecting Heel-Strikes compared to Toe-Offs.•An alternative way of assessing performance based on non-parametric statistical tests. Numerous gait event detection (GED) algorithms have been developed using accelerometers as they allow the possibility of long-term gait analysis in everyday life. However, almost all such existing algorithms have been developed and assessed using data collected in controlled indoor experiments with pre-defined paths and walking speeds. On the contrary, human gait is quite dynamic in the real-world, often involving varying gait speeds, changing surfaces and varying surface inclinations. Though portable wearable systems can be used to conduct experiments directly in the real-world, there is a lack of publicly available gait datasets or studies evaluating the performance of existing GED algorithms in various real-world settings. This paper presents a new gait database called MAREA (n=20 healthy subjects) that consists of walking and running in indoor and outdoor environments with accelerometers positioned on waist, wrist and both ankles. The study also evaluates the performance of six state-of-the-art accelerometer-based GED algorithms in different real-world scenarios, using the MAREA gait database. The results reveal that the performance of these algorithms is inconsistent and varies with changing environments and gait speeds. All algorithms demonstrated good performance for the scenario of steady walking in a controlled indoor environment with a combined median F1score of 0.98 for Heel-Strikes and 0.94 for Toe-Offs. However, they exhibited significantly decreased performance when evaluated in other lesser controlled scenarios such as walking and running in an outdoor street, with a combined median F1score of 0.82 for Heel-Strikes and 0.53 for Toe-Offs. Moreover, all GED algorithms displayed better performance for detecting Heel-Strikes as compared to Toe-Offs, when evaluated in different scenarios.