Personalized Activity Recognition Using Partially Available Target Data

• Published in: IEEE transactions on mobile computing Vol. 22; no. 1; pp. 374 - 388
• Main Authors: Fallahzadeh, Ramin, Ashari, Zhila Esna, Alinia, Parastoo, Ghasemzadeh, Hassan
• Format: Magazine Article
• Language: English
• Published: Los Alamitos IEEE 01.01.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Accuracy; Activity recognition; Adaptation models; Algorithms; Clustering; Combinatorial analysis; cross-subject boosting; Customization; Datasets; Domains; Graph theory; Labels; Machine learning; Mapping; Mobile computing; Optimization; Training; Transfer learning; Transportation problem; Wearable computers; wearable computing
• ISSN: 1536-1233; 1558-0660
• DOI: 10.1109/TMC.2021.3071434

Recent years have witnessed a growing body of research on autonomous activity recognition models for use in deployment of mobile systems in new settings such as when a wearable system is adopted by a new user. Current research, however, lacks comprehensive frameworks for transfer learning. Specifically, it lacks the ability to deal with partially available data in new settings. To address these limitations, we propose OptiMapper , a novel uninformed cross-subject transfer learning framework for activity recognition. OptiMapper is a combinatorial optimization framework that extracts abstract knowledge across subjects and utilizes this knowledge for developing a personalized and accurate activity recognition model in new subjects. To this end, a novel community-detection-based clustering of unlabeled data is proposed that uses the target user data to construct a network of unannotated sensor observations. The clusters of these target observations are then mapped onto the source clusters using a complete bipartite graph model. In the next step, the mapped labels are conditionally fused with the prediction of a base learner to create a personalized and labeled training dataset for the target user. We present two instantiations of OptiMapper. The first instantiation, which is applicable for transfer learning across domains with identical activity labels, performs a one-to-one bipartite mapping between clusters of the source and target users. The second instantiation performs optimal many-to-one mapping between the source clusters and those of the target. The many-to-one mapping allows us to find an optimal mapping even when the target dataset does not contain sufficient instances of all activity classes. We show that this type of cross-domain mapping can be formulated as a transportation problem and solved optimally. We evaluate our transfer learning techniques on several activity recognition datasets. Our results show that the proposed community detection approach can achieve, on average, 69 percent utilization of the datasets for clustering with an overall clustering accuracy of 87.5 percent. Our results also suggest that the proposed transfer learning algorithms can achieve up to 22.5 percent improvement in the activity recognition accuracy, compared to the state-of-the-art techniques. The experimental results also demonstrate high and sustained performance even in presence of partial data.