Evaluating the effectiveness of blended learning using the ARCS model

• Published in: Journal of computer assisted learning Vol. 37; no. 5; pp. 1397 - 1408
• Main Authors: Ma, Long, Lee, Chei Sian
• Format: Journal Article
• Language: English
• Published: Chichester, UK John Wiley & Sons, Inc 01.10.2021; Wiley; Wiley Subscription Services, Inc
• Subjects: ARCS model; Attention; Blended Learning; Colleges & universities; Course Content; COVID-19; Distance learning; Educational Benefits; effectiveness; Electronic Learning; Evaluation; Higher education; Higher education institutions; Learning Motivation; Learning Processes; Learning Strategies; Online Courses; Pandemics; Perception; Perceptions; Program Effectiveness; Program Evaluation; randomized experiments; Self Concept; Student Satisfaction; Students; Subjective assessment; Teachers; Training
• ISSN: 0266-4909; 1365-2729
• DOI: 10.1111/jcal.12579

While the educational disruption caused by the Covid‐19 pandemic underscores the importance of blended learning in higher education, research on the effectiveness of blended learning is still inconclusive. Drawing from the motivational design model of the ARCS (i.e., attention, relevance, confidence, and satisfaction), this study attempts to fill the gap to evaluate effectiveness of blended learning from a multi‐dimensional perspective. Participants were randomly assigned into three experimental groups (i.e., face‐to‐face, pure online, and blended). A questionnaire survey was administered in each group after the trial courses. The data was analysed by using the one‐way ANOVA with post hoc tests. The results showed that blended learning outperformed pure online learning in enhancing students' attention, confidence, and satisfaction perceptions. Additionally, blended learning had a higher level of satisfaction perception than face‐to‐face learning. Follow‐up interviews were also conducted to provide an in‐depth understanding of how blended learning motivated students during the learning process. Considering that blended learning may become a new normal in higher education after the Covid‐19 pandemic, the findings of the present study provide evidences to support the effectiveness of the blended learning approach in addressing students' motivational needs. Lay Description What is already known about this topic? Blended learning, also called as hybrid learning, is a learning approach that combines face‐to‐face learning with online learning; It is able to integrate benefits afforded by both traditional face‐to‐face learning and pure online learning to deliver course content; However, the findings concerned with the effectiveness of blended learning are mixed; The measurements of learning effectiveness in previous studies are often based on single variables (e.g., test score or students' satisfaction), but neglect the multi‐dimensional nature of learning effectiveness. What this paper adds? Based on motivational design model of the ARCS (i.e., attention, relevance, confidence, and satisfaction), the present study compared the effectiveness of blended learning with other learning approaches (e.g., pure online learning and face‐to‐face learning) through a randomized experiment; It was identified that blended learning outperformed pure online learning in enhancing students' perceptions of attention, confidence, and satisfaction; Blended learning also had a higher level of satisfaction perception compared to face‐to‐face learning; Last but not least, evaluating learning effectiveness from an integrated lens of objective assessment based on test scores and subjective assessment based on the multi‐motivational perspectives is an important first step to understanding the effectiveness of blended learning to support learning in higher education in the future. Implications for practice and/or policy As blended learning outperforms pure online in several motivational appeals, it is recommended that universities should consider conducting blended learning as far as possible rather than pure online learning; Learning strategies can be applied to trigger students' curiosity and keep them engaged continuously in the learning process, such as utilizing a variety of online quality resources, and interacting with students from other universities through online communities; As the confidence of taking blended learning courses varies among different levels of students, instructors should try to provide sufficient support during the learning process especially for the online sections; Since satisfaction is identified as a critical motivator, instructors should pay more attention on how to improve students' satisfaction through the design of blended learning, such as try controlling the length of course videos and interacting with students synchronously in the online course platforms; Last but not least, since some of the tasks in blended learning need to be initiated and completed by students themselves, it is necessary for educational institutions to consider incorporating the training for self‐regulation as part of their competence based training.