임상수행능력평가(CPX)에서 학교효과가 신뢰도에 미치는 영향

Purpose: The purpose of this study is to test the reliability of the clinical performance examination (CPX) using Generalizability theory (G-theory). Through G-theory, the effects of not only students and tasks but also the school will be analyzed as primary sources of error, which can affect the in...

Full description

Saved in:
Bibliographic Details
Published inKorean journal of medical education Vol. 22; no. 3; pp. 215 - 223
Main Authors 임미경(Mi Kyoung Yim), 이규민(Gue Min Lee)
Format Journal Article
LanguageKorean
Published 한국의학교육학회 30.09.2010
Subjects
Online AccessGet full text
ISSN2005-727X
2005-7288

Cover

More Information
Summary:Purpose: The purpose of this study is to test the reliability of the clinical performance examination (CPX) using Generalizability theory (G-theory). Through G-theory, the effects of not only students and tasks but also the school will be analyzed as primary sources of error, which can affect the interpretation of the reliability of the CPX. Methods: One thousand three hundred nineteen students from 16 medical schools that participated in the Seoul-Gyeonggi CPX Consortium 2008 were enrolled. In our research design, we suppose that student is nested within school and crossed with task. Data analysis was conducted with urGenova. Results: According to our analysis, the percentage of error variance was 6.2% for school, 14.9% for student nested within school,14.4% for task, and 3% for interaction between school and task. An effect of school on students was observed, but the interaction between task and school was insignificant. When student is nested within school, the universe score decreased and the g-coefficient was less than the g-coefficient of the p × t (p: studentm, t: task) design. Conclusion: The results show that generalizability theory is useful in detecting various error components in the CPX. Using the generalizability theory to improve the technical quality of performance assessments provides us with greater information compared with traditional test theories. KCI Citation Count: 7
Bibliography:G704-001470.2010.22.3.005
http://dx.doi.org/10.3946/kjme.2010.22.3.215
ISSN:2005-727X
2005-7288