Automated Evaluation of School Children Essays in Arabic

• Published in: Procedia computer science Vol. 117; pp. 19 - 22
• Main Authors: Al-Jouie, Maram F., Azmi, Aqil M.
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 2017
• Subjects: Automatic essay scoring; Essay evaluation; Latent Semantic Analysis; Rhetorical Structure Theory; Latent Semantic Analysis; Rhetorical Structure Theory; Automatic essay scoring; Essay evaluation
• ISSN: 1877-0509; 1877-0509
• DOI: 10.1016/j.procs.2017.10.089

The most effective technique for improving students writing skills is for them to get immediate instructor’s feedback and as often as possible. This, however, significantly expands the workload of the instructors. There is a growing need for automated systems to help students draft essays. Automated essay evaluation is increasingly popular in the field of educational evaluation technology. In this work, we present an automatic evaluator of student essays in Arabic language, a system that is modeled on the scheme followed by the school-teachers in Riyadh, the capital of Saudi Arabia. The main criteria for assessing the essays is: language proficiency; the structure of the essay; and the content which should match the topic. With this in mind, we developed a scheme that relies on latent semantic analysis, and rhetorical structure theory. The system was tested on over 300 different essays, all handwritten by schoolchildren covering various subjects. The performance was measured by machine-human correlation in grading. Our system achieved an overall correlation of 0.79 with the teachers’ evaluation.