Linguistic summarization of in-home sensor data

• Published in: Journal of biomedical informatics Vol. 96; p. 103240
• Main Authors: Jain, Akshay, Popescu, Mihail, Keller, James, Rantz, Marilyn, Markway, Brianna
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 01.08.2019
• Subjects: Aging in place; Data to text; Early illness detection; In-home sensor monitoring; Linguistic protoform summary; Natural Language Generation; Sensor summarization; In-home sensor monitoring; Data to text; Aging in place; Sensor summarization; Linguistic protoform summary; Natural Language Generation; Early illness detection
• ISSN: 1532-0464; 1532-0480; 1532-0480
• DOI: 10.1016/j.jbi.2019.103240

[Display omitted] •Linguistically summarize sensor data obtained from homes of elderly.•Identify important health relevant features and develop algorithms to compute them.•Validate algorithms using multiple expert based surveys.•Multiple Case studies show correlation between summaries and changes in health.•System is running in 110 apartments as part of a Randomized Controlled Trial. With the increase in the population of older adults around the world, a significant amount of work has been done on in-home sensor technology to aid the elderly age independently. However, due to the large amounts of data generated by the sensors, it takes a lot of effort and time for the clinicians to makes sense of this data. In this work, we develop a system to help make this data more useful by presenting it in the form of natural language. We start by identifying important attributes in the sensor data that are relevant to the health of the elderly. We then develop algorithms to extract these important health related features from the sensor parameters and summarize them in natural language. We focus on making the natural language summaries to be informative, accurate and concise. We designed multiple surveys using real and synthetic data to validate the summaries produced by our algorithms. We show that the algorithms produce meaningful results comparable to human subjects. We also implemented our linguistic summarization system to produce summaries of data leading to health alerts derived from the sensor data. The system is running live in 110 apartments currently. By the means of retrospective case studies, we illustrate that the linguistic summaries are able to make the connection between changes in the sensor data and the health of the elderly. We present a system that extracts important clinically relevant features from in-home sensor data generated in the apartments of the elderly and summarize those features in natural language. The preliminary testing of our summarization system shows that it has the potential to help the clinicians utilize this data effectively.