Designing an Artificial Agent for Cognitive Apprenticeship Learning of Elevator Pitch in Virtual Reality

• Published in: IEEE transactions on cognitive and developmental systems Vol. 14; no. 3; pp. 857 - 868
• Main Authors: Zhao, Zhenjie, Ma, Xiaojuan
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.09.2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Agents (artificial intelligence); Apprenticeship; Artificial agent; cognitive apprenticeship (CA); College students; Data collection; Elevator pitch; Elevators; Elevators (control surfaces); embodied feedback; Engineering profession; Feedback; Interviews; Learning; oral presentation skill development; perception; situated learning; Timing; Training; user study; Virtual reality; virtual reality (VR); Visualization
• ISSN: 2379-8920; 2379-8939
• DOI: 10.1109/TCDS.2021.3073814

Developing social skills like elevator pitch requires being situated within authentic activities and contexts, which is difficult to achieve on a daily basis. In this work, we explore whether an artificial agent with embodied feedback in virtual reality (VR) can foster a situated learning experience. Previous works on computer-mediated feedback have shown that VR can foster oral presentation competence for preuniversity and junior undergraduates through delivering feedback. However, it is unclear how well the learning experiences are and how well students perceive an artificial coach in VR, especially for senior undergraduates and postgraduates seeking job and research opportunities. To inform the design of such a system, we conducted interviews with experts and observed real elevator pitches. We then designed a proof-of-concept VR coaching system with three embodied feedback strategies: immediate, after-action, and the combination of both. Through a between-subject experiment with 40 participants, we studied learners' perceptions under the embodied feedback. We found that receiving embodied feedback can create a stronger sense of cognitive apprenticeship, i.e., coaching and helping from experts, and help improve the perception of the artificial agent and the effect of learning. We further investigated the pros and cons of different strategies and discussed room for improvement.