Agreement Between Single Raters and Team Rating When Applying the International Classification of Functioning, Disability and Health’s Rehabilitation Set

• Published in: Journal of rehabilitation medicine Vol. 55; p. jrm14737
• Main Authors: Zhang, Malan, Zhang, Yun, Sui, Minghong, Wang, Liyin, Lin, Ziling, Shen, Wei, Yu, Jiani, Yan, Tiebin
• Format: Journal Article
• Language: English
• Published: Sweden Medical Journals Sweden AB 04.12.2023; Medical Journals Sweden
• Subjects: Activities of Daily Living; Adult; assessment; Disability Evaluation; Disabled Persons - rehabilitation; Humans; International Classification of Functioning Disability and Health; Original Report; rehabilitation; Rehabilitation Centers; Reproducibility of Results; team evaluation
• ISSN: 1651-2081; 1650-1977; 1651-2081
• DOI: 10.2340/jrm.v55.14737

Objective: To quantify the agreement between functional assessments by a single rater and a team using the Chinese version of the International Classification of Functioning, Disability and Health Rehabilitation Set in a clinical situation. Design: Inter-rater, multi-centre agreement study. Subjects: A total of 193 adult inpatients admitted to 5 rehabilitation centres at 5 hospitals in China Methods: The Chinese version of the International Classification of Functioning, Disability and Health Rehabilitation Set was used by either a single rater or a team to assess 193 patients at 5 Chinese hospitals. Percentage of agreement and quadratic-weighted kappa coefficients were computed. Evaluation times were compared with paired t-tests. Results: The mean team and individual evaluation times were not significantly different. The percentage of agreement ranged from 46.1% to 94.2% depending on the item, and the quadratic-weighted kappas ranged from 0.43 to 0.92. Eight categories (26.6%) showed a weighted kappa exceeding 0.4, 11 others (36.7%) exceeded 0.6, and another 11 (36.7%) produced kappas of more than 0.8. Conclusion: Either a single rater or a team of raters can produce valid and consistent ratings when using the Chinese version of the International Classification of Functioning, Disability and Health Rehabilitation Set to assess patients in a rehabilitation department. The team rating approach is suitable for clinical application.