An interactive fitness-for-use data completeness tool to assess activity tracker data

• Published in: Journal of the American Medical Informatics Association : JAMIA Vol. 29; no. 12; pp. 2032 - 2040
• Main Authors: Cho, Sylvia, Ensari, Ipek, Elhadad, Noémie, Weng, Chunhua, Radin, Jennifer M, Bent, Brinnae, Desai, Pooja, Natarajan, Karthik
• Format: Journal Article
• Language: English
• Published: England Oxford University Press 14.11.2022
• Subjects: Data Accuracy; Exercise; Fitness Trackers; Humans; Research and Applications; usability testing; data quality; fitness trackers; user-centered design; patient-generated health data
• ISSN: 1067-5027; 1527-974X; 1527-974X
• DOI: 10.1093/jamia/ocac166

To design and evaluate an interactive data quality (DQ) characterization tool focused on fitness-for-use completeness measures to support researchers' assessment of a dataset. Design requirements were identified through a conceptual framework on DQ, literature review, and interviews. The prototype of the tool was developed based on the requirements gathered and was further refined by domain experts. The Fitness-for-Use Tool was evaluated through a within-subjects controlled experiment comparing it with a baseline tool that provides information on missing data based on intrinsic DQ measures. The tools were evaluated on task performance and perceived usability. The Fitness-for-Use Tool allows users to define data completeness by customizing the measures and its thresholds to fit their research task and provides a data summary based on the customized definition. Using the Fitness-for-Use Tool, study participants were able to accurately complete fitness-for-use assessment in less time than when using the Intrinsic DQ Tool. The study participants perceived that the Fitness-for-Use Tool was more useful in determining the fitness-for-use of a dataset than the Intrinsic DQ Tool. Incorporating fitness-for-use measures in a DQ characterization tool could provide data summary that meets researchers needs. The design features identified in this study has potential to be applied to other biomedical data types. A tool that summarizes a dataset in terms of fitness-for-use dimensions and measures specific to a research question supports dataset assessment better than a tool that only presents information on intrinsic DQ measures.