Can prospective usability evaluation predict data errors?

• Published in: AMIA ... Annual Symposium proceedings Vol. 2010; pp. 346 - 350
• Main Authors: Johnson, Constance M, Nahm, Meredith, Shaw, Ryan J, Dunham, Ashley, Newby, Kristin, Dolor, Rowena, Smerek, Michelle, Del Fiol, Guilherme, Zhang, Jiajie
• Format: Journal Article
• Language: English
• Published: United States American Medical Informatics Association 13.11.2010
• Subjects: Data Collection; Humans; Information Storage and Retrieval; Prospective Studies; User-Computer Interface
• ISSN: 1942-597X; 1559-4076

Increasing amounts of clinical research data are collected by manual data entry into electronic source systems and directly from research subjects. For this manual entered source data, common methods of data cleaning such as post-entry identification and resolution of discrepancies and double data entry are not feasible. However data accuracy rates achieved without these mechanisms may be higher than desired for a particular research use. We evaluated a heuristic usability method for utility as a tool to independently and prospectively identify data collection form questions associated with data errors. The method evaluated had a promising sensitivity of 64% and a specificity of 67%. The method was used as described in the literature for usability with no further adaptations or specialization for predicting data errors. We conclude that usability evaluation methodology should be further investigated for use in data quality assurance.