Accuracy of Re-estimation of the National Assessment of Academic Ability (Parent Questionnaire and Long-Term Trend Survey) Using Multidimensional Item Response Theory and Plausible Values

• Published in: Japanese Journal for Research on Testing Vol. 20; no. 1; pp. 73 - 89
• Main Author: Kawaguchi, Toshiaki
• Format: Journal Article
• Language: Japanese
• Published: The Japan Association for Research on Testing 2024; 日本テスト学会
• Subjects: Long-term Trend Survey; Multidimensional Item Response Theory; National Assessment of Academic Ability; Parent Questionnaire; Plausible Values; Simulation Study; シミュレーション; 保護者に対する調査; 全国学力・学習状況調査; 多次元項目反応モデル; 推算値法; 経年変化分析調査
• ISSN: 1880-9618; 2433-7447
• DOI: 10.24690/jart.20.1_73

In the "Parent Questionnaire" and "Long-Term Trend Survey" of the National Assessment of Academic Ability conducted by the Ministry of Education, Culture, Sports, Science and Technology, there is a problem that not all data from the Parent Questionnaire can be used for analyzing. This is because the data from the Long-Term Trend Survey are sampled by subject area. To overcome this problem, a method has been proposed to re-estimate academic ability by combining data from the Parent Questionnaire, the Long-Term Trends Survey, and the National Assessment of Academic Ability using multidimensional item response theory and plausible values. In this article, I confirm the accuracy of this estimation method through a simulation study.In conclusion, I found that this method can effectively recover population parameters such as mean and standard deviation of subpopulations, correlation coefficients between socioeconomic status (SES) and academic achievement, as well as coefficients derived from regression analyses.