AIを活用した英文ライティング自動評価採点システムのスコア予測精度の検証
Saved in:
| Published in | 日本言語テスト学会誌 Vol. 25; pp. 21 - 39 |
|---|---|
| Main Author | |
| Format | Journal Article |
| Language | Japanese |
| Published |
日本言語テスト学会
2022
|
| Subjects | |
| Online Access | Get full text |
| ISSN | 2189-5341 2189-9746 |
| DOI | 10.20622/jltajournal.25.0_21 |
Cover
| Author | 杉田, 由仁 |
|---|---|
| Author_xml | – sequence: 1 fullname: 杉田, 由仁 organization: 明治学院大学 |
| BookMark | eNpNUMtKw0AAXKSCtfYP_IXU7GaTzR5LfRUKXvQctunGNsRWknrw2ASsUPAgVi-CVou0IuIL1Cr9mW3TfIYpFvEyM8wMc5hFkKjWqhyAZShnkKwhtGI7dWbXDtwqczJIzcgGgnMgiaBOJUqwlphpVcFwAaQ9r1KUMSYqxgpOgnI2L_zT8O1rctYTjQvRuIpaz-F5UwR94XdFcCT8WxG8Cv8pat6PW-2o3x4NO-FJZ-J_Cv9dxBh3gmvReJxqP27ejAbH4cfD5GU4HtzFfti9jHrfS2DeYo7H0zNOgZ31te3cplTY2sjnsgXJRhASicmYF5GmW4giqhFqEk4UppSICXXN0jhEiKoqUxm0TFWxSjKhls4tBCmlJP5DSYHV313bq7Ndbuy7lT3mHhrMrVdMhxv_3jKQashTQPAvNsvMNWym_ACC8Y48 |
| ContentType | Journal Article |
| Copyright | 2022 日本言語テスト学会 |
| Copyright_xml | – notice: 2022 日本言語テスト学会 |
| DOI | 10.20622/jltajournal.25.0_21 |
| DeliveryMethod | fulltext_linktorsrc |
| EISSN | 2189-9746 |
| EndPage | 39 |
| ExternalDocumentID | article_jltajournal_25_0_25_21_article_char_ja |
| GroupedDBID | ALMA_UNASSIGNED_HOLDINGS JSF KQ8 RJT |
| ID | FETCH-LOGICAL-j2117-a04eb268f2929679c7e73a3d7c186f6e122955a5a1fc53fd079f8ef2199972063 |
| ISSN | 2189-5341 |
| IngestDate | Wed Sep 03 06:30:28 EDT 2025 |
| IsDoiOpenAccess | true |
| IsOpenAccess | true |
| IsPeerReviewed | false |
| IsScholarly | false |
| Language | Japanese |
| License | https://creativecommons.org/licenses/by-nc-nd/4.0/deed.ja |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-j2117-a04eb268f2929679c7e73a3d7c186f6e122955a5a1fc53fd079f8ef2199972063 |
| OpenAccessLink | https://www.jstage.jst.go.jp/article/jltajournal/25/0/25_21/_article/-char/ja |
| PageCount | 19 |
| ParticipantIDs | jstage_primary_article_jltajournal_25_0_25_21_article_char_ja |
| PublicationCentury | 2000 |
| PublicationDate | 2022 |
| PublicationDateYYYYMMDD | 2022-01-01 |
| PublicationDate_xml | – year: 2022 text: 2022 |
| PublicationDecade | 2020 |
| PublicationTitle | 日本言語テスト学会誌 |
| PublicationYear | 2022 |
| Publisher | 日本言語テスト学会 |
| Publisher_xml | – name: 日本言語テスト学会 |
| References | Schultz, M. T. (2013). The IntelliMetric automated essay scoring Engine—A review and an application to Chinese essay scoring. Handbook of automated essay evaluation: Current applications and new directions (pp. 89–98). Routledge. 杉田由仁. (2013). 日本人英語学習者のためのタスクによるライティング評価法―構成概念に基づく言語処理的評価法―. 大学教育出版. 杉田由仁. (2012). ライティング評価における評定者の行動分析と評価基準の妥当性検証. JACET 関東支部学会誌, 8, 14–26. Hyland, K. (2003). Second language writing. Cambridge University Press. Sugita, Y. (2010). Reliability and validity of a task-based writing performance assessment for Japanese learners of English. JLTA Journal, 13, 21–40. https://doi.org/10.20622/jltaj.13.0_21 梅田弘之. (2019). エンジニアなら知っておきたいAIの基本. インプレス. O’Sullivan, B., & Weir, C. J. (2011). Test development and validation. In O’Sullivan, B. (Ed.), Language testing: Theories and practices (pp.13–32). Palgrave Macmillan. Warschauer, M. & Ware, P. (2006). Automated writing evaluation: Defining the classroom research agenda. Language Teaching Research, 10, 157–180. Sugita, Y. (2009b). Developing and improving rating scales for a task-based writing performance test. JLTA Journal, 12, 85–103. https://doi.org/10.20622/jltaj.12.0_85 Sugita, Y. (2012). Effects of rater training on raters’ severity, consistence, and biased Interactions in a task-based writing assessment. JLTA Journal, 15, 61–80. https://doi.org/10.20622/jltajournal.15.0_61 Linacre, J. M. (2008). Facets: Many-Facet Rasch-measurement (Version 3.63.0) [Computer software]. MESA Press. Sugita, Y. (2009a). The development and implementation of task-based writing performance assessment for Japanese learners of English. Journal of Pan-Pacific Association of Applied Linguistics, 13, 77–103. https://eric.ed.gov/?q=Yoshihito+Sugita&ft=on Linacre, J. M. (2021). A user’s guide to FACETS: Rasch-model computer programs (Program manual 3.83.5). http://www.winsteps.com/a/facets-manual.pdf Foltz, P., Streeter, L., Lochbaum, K., & Landauer, T. (2013). Implementation and applications of the intelligent essay assessor. Handbook of automated essay evaluation: Current applications and new directions (pp. 68–88). Routledge. Skehan, P. (1998). A cognitive approach to language learning. Oxford University Press. Burstein, J., Tetreault, J., & Madnani, N. (2013). The e-rater automated essay scoring system. Handbook of automated essay evaluation: Current applications and new directions (pp. 55–67). Routledge. Linacre, J. M. (2021). Facets: Many-Facet Rasch-measurement (Version 3.83.6) [Computer software]. MESA Press. Sugita, Y. (2013). Comparability of accuracy and communicability tasks: Are they all equally difficult? JLTA Journal, 16, 67–86. https://doi.org/10.20622/jltajournal.160_67 Weigle, S. C. (2010). Validation of automated scores of TOEFL iBT tasks against non-test indicators of writing ability. Language Testing, 27, 335–353. Sugita, Y. (2016). Examination of objective rating indices to an automated essay-scoring system for task-based writing tests. ARELE, 27, 17–32. Sugita, Y. (2019). Reliability and validity of an automated essay scoring system for a task-based writing test. ARELE, 30, 17–32. Rudner, L. M., Garcia, V., & Welch, C. (2006). An evaluation of the IntelliMetric ™ essay scoring system. Journal of Technology, Learning, and Assessment, 4. https://ejournals.bc.edu/index.php/jtla/article /view/1651/1493 総務省. (2019). AIと機械学習・深層学習の関係. 令和元年度版情報通信白書. https://www.soumu.go.jp/johotsusintokei/whitepaper/ja/r01/html/nd113210.html |
| References_xml | – reference: Linacre, J. M. (2021). Facets: Many-Facet Rasch-measurement (Version 3.83.6) [Computer software]. MESA Press. – reference: O’Sullivan, B., & Weir, C. J. (2011). Test development and validation. In O’Sullivan, B. (Ed.), Language testing: Theories and practices (pp.13–32). Palgrave Macmillan. – reference: Skehan, P. (1998). A cognitive approach to language learning. Oxford University Press. – reference: Linacre, J. M. (2021). A user’s guide to FACETS: Rasch-model computer programs (Program manual 3.83.5). http://www.winsteps.com/a/facets-manual.pdf – reference: Sugita, Y. (2009b). Developing and improving rating scales for a task-based writing performance test. JLTA Journal, 12, 85–103. https://doi.org/10.20622/jltaj.12.0_85 – reference: Warschauer, M. & Ware, P. (2006). Automated writing evaluation: Defining the classroom research agenda. Language Teaching Research, 10, 157–180. – reference: Sugita, Y. (2012). Effects of rater training on raters’ severity, consistence, and biased Interactions in a task-based writing assessment. JLTA Journal, 15, 61–80. https://doi.org/10.20622/jltajournal.15.0_61 – reference: Foltz, P., Streeter, L., Lochbaum, K., & Landauer, T. (2013). Implementation and applications of the intelligent essay assessor. Handbook of automated essay evaluation: Current applications and new directions (pp. 68–88). Routledge. – reference: 杉田由仁. (2013). 日本人英語学習者のためのタスクによるライティング評価法―構成概念に基づく言語処理的評価法―. 大学教育出版. – reference: Sugita, Y. (2013). Comparability of accuracy and communicability tasks: Are they all equally difficult? JLTA Journal, 16, 67–86. https://doi.org/10.20622/jltajournal.160_67 – reference: Weigle, S. C. (2010). Validation of automated scores of TOEFL iBT tasks against non-test indicators of writing ability. Language Testing, 27, 335–353. – reference: Schultz, M. T. (2013). The IntelliMetric automated essay scoring Engine—A review and an application to Chinese essay scoring. Handbook of automated essay evaluation: Current applications and new directions (pp. 89–98). Routledge. – reference: Sugita, Y. (2016). Examination of objective rating indices to an automated essay-scoring system for task-based writing tests. ARELE, 27, 17–32. – reference: 杉田由仁. (2012). ライティング評価における評定者の行動分析と評価基準の妥当性検証. JACET 関東支部学会誌, 8, 14–26. – reference: Linacre, J. M. (2008). Facets: Many-Facet Rasch-measurement (Version 3.63.0) [Computer software]. MESA Press. – reference: 総務省. (2019). AIと機械学習・深層学習の関係. 令和元年度版情報通信白書. https://www.soumu.go.jp/johotsusintokei/whitepaper/ja/r01/html/nd113210.html – reference: Hyland, K. (2003). Second language writing. Cambridge University Press. – reference: Rudner, L. M., Garcia, V., & Welch, C. (2006). An evaluation of the IntelliMetric ™ essay scoring system. Journal of Technology, Learning, and Assessment, 4. https://ejournals.bc.edu/index.php/jtla/article /view/1651/1493 – reference: Sugita, Y. (2009a). The development and implementation of task-based writing performance assessment for Japanese learners of English. Journal of Pan-Pacific Association of Applied Linguistics, 13, 77–103. https://eric.ed.gov/?q=Yoshihito+Sugita&ft=on – reference: Sugita, Y. (2010). Reliability and validity of a task-based writing performance assessment for Japanese learners of English. JLTA Journal, 13, 21–40. https://doi.org/10.20622/jltaj.13.0_21 – reference: 梅田弘之. (2019). エンジニアなら知っておきたいAIの基本. インプレス. – reference: Sugita, Y. (2019). Reliability and validity of an automated essay scoring system for a task-based writing test. ARELE, 30, 17–32. – reference: Burstein, J., Tetreault, J., & Madnani, N. (2013). The e-rater automated essay scoring system. Handbook of automated essay evaluation: Current applications and new directions (pp. 55–67). Routledge. |
| SSID | ssib044754434 ssib026211950 ssj0003306497 |
| Score | 1.8828049 |
| SourceID | jstage |
| SourceType | Publisher |
| StartPage | 21 |
| SubjectTerms | AI スコア予測精度 ライティング・テスト 自動採点 |
| Title | AIを活用した英文ライティング自動評価採点システムのスコア予測精度の検証 |
| URI | https://www.jstage.jst.go.jp/article/jltajournal/25/0/25_21/_article/-char/ja |
| Volume | 25 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| ispartofPNX | 日本言語テスト学会誌, 2022, Vol.25, pp.21-39 |
| journalDatabaseRights | – providerCode: PRVAFT databaseName: Open Access Digital Library customDbUrl: eissn: 2189-9746 dateEnd: 99991231 omitProxy: true ssIdentifier: ssj0003306497 issn: 2189-5341 databaseCode: KQ8 dateStart: 20150101 isFulltext: true titleUrlDefault: http://grweb.coalliance.org/oadl/oadl.html providerName: Colorado Alliance of Research Libraries – providerCode: PRVHPJ databaseName: ROAD: Directory of Open Access Scholarly Resources customDbUrl: eissn: 2189-9746 dateEnd: 99991231 omitProxy: true ssIdentifier: ssib044754434 issn: 2189-5341 databaseCode: M~E dateStart: 20110101 isFulltext: true titleUrlDefault: https://road.issn.org providerName: ISSN International Centre |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrR1NaxQxdKj14kUUFb_pwRxnnUkmmeTgIbOd0nrw1EJvw8zuDLJIFdlePAg7C1YoeBCrF0GrRVoR8QvUKsX_Mu12f4YvmUx3t_Rg1Ut485K895KXTd7LJi-WdcVNMdjJKbbTDFNwUBxhx2mM7SZJYDVqEEYTHe3zBpue867P0_mxI7-GTi0ttpNa496B90r-RquAA72qW7KH0OweUUAADPqFFDQM6R_pWM6gkCCOkcAoZCjwUBCg0EfCQ5LrLBcJvwKmUMgRD1DgqsKCIV5mqX_KDR3pGQxnFYYYTEAMJnA0HR9JiUKqCAqqMEBEASBDiKRmwUvA17UqFoFfAWKUF4jhGFFlOFoGD7hLrFlIxLluMvCtKxYBVnxBHsiSbIgOU40SdS0hR-Yhb2ON636AhlAN1DUpXYzrNkIDRbi_QwZic8VOTmp2IFIdCWlq8b2tZ014EnFh1AKdB2O6-nB1xQCVz8lUmy944KT_dwEH8z4YXcKmpIwHVksHOHD92PDChenIyjNkw5TxofavjthhWIXbbd1qx2YU1zCtOVFVdyTuuBnV0VDpCNPIUQl2oypbXQ6MWuChHMVqR0wdnr0fVjM6Zli_M1x9q-iSXhWQUNlKRDnA-gWkvVaX91u1rFcPkBQsxRb4TdWZS20Gzp6wjhv_bUKWcp20xlrxKeumnCnyx70vP3afrBedZ0XnRX_5Y-_pUtHdKPK1ovugyF8X3c9F_qG_9HZneaW_sbK9tdp7tLqbfy_yrwWkUKb7sui8V3AOJV9tbz7sfXu3-2lrZ_MN4Htrz_vrP09bc1PhbH3aNk-Y2C1ouW_HjpcmmPEMgxvCfNHwU5_EpOk3XM4ylroYC0pjGrtZg5Ks6fgi4zBtquAgPvQBOWONL9xeSM9aEzBzNrLExYlLfK8ZOzFWB5yaXubRZhqT-Jx1reyY6E4ZpyY6nAbP_2P9C9Yx9QsptycvWuPtu4vpJTDY28llPSZ-Azw5zhU |
| linkProvider | ISSN International Centre |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=AI%E3%82%92%E6%B4%BB%E7%94%A8%E3%81%97%E3%81%9F%E8%8B%B1%E6%96%87%E3%83%A9%E3%82%A4%E3%83%86%E3%82%A3%E3%83%B3%E3%82%B0%E8%87%AA%E5%8B%95%E8%A9%95%E4%BE%A1%E6%8E%A1%E7%82%B9%E3%82%B7%E3%82%B9%E3%83%86%E3%83%A0%E3%81%AE%E3%82%B9%E3%82%B3%E3%82%A2%E4%BA%88%E6%B8%AC%E7%B2%BE%E5%BA%A6%E3%81%AE%E6%A4%9C%E8%A8%BC&rft.jtitle=%E6%97%A5%E6%9C%AC%E8%A8%80%E8%AA%9E%E3%83%86%E3%82%B9%E3%83%88%E5%AD%A6%E4%BC%9A%E8%AA%8C&rft.au=%E6%9D%89%E7%94%B0%2C+%E7%94%B1%E4%BB%81&rft.date=2022&rft.pub=%E6%97%A5%E6%9C%AC%E8%A8%80%E8%AA%9E%E3%83%86%E3%82%B9%E3%83%88%E5%AD%A6%E4%BC%9A&rft.issn=2189-5341&rft.eissn=2189-9746&rft.volume=25&rft.spage=21&rft.epage=39&rft_id=info:doi/10.20622%2Fjltajournal.25.0_21&rft.externalDocID=article_jltajournal_25_0_25_21_article_char_ja |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2189-5341&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2189-5341&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2189-5341&client=summon |