Supporting Multitracking Performance With Novel Visual, Auditory, and Tactile Displays

• Published in: IEEE transactions on human-machine systems Vol. 50; no. 1; pp. 79 - 88
• Main Authors: Yang, Shiyan, Ferris, Thomas K.
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.02.2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Auditory displays; Complexity theory; Configurations; Continuity (mathematics); Data processing; Displays; Driving performance; Encoding; Information processing; Multidimensional methods; multimodal information processing; multisensory display; Signal encoding; Tactile; Target tracking; Task analysis; Tracking; Visualization
• ISSN: 2168-2291; 2168-2305
• DOI: 10.1109/THMS.2019.2947580

This article investigates performance in multiple concurrent tracking tasks with multisensory displays in a driving context. In many work domains, such as driving, aviation, process control, and medicine, humans perform "tracking" tasks that involve observing continuous variables and providing a control input to achieve and maintain satisfactory levels in those variables. Performance in multiple concurrent tracking tasks ("multitracking") was studied in driving-like scenarios that challenged participants to track established targets for lateral (lane position) and longitudinal (speed) variables. Novel speed displays were developed to engage nontraditional sensory modalities (e.g., ambient-visual, auditory, or tactile) with relative speed conveyed through simple or multidimensional signal encoding methods. Participants' speed-tracking and lane-tracking performances were measured concurrently and compared across display configurations within-subjects. Results showed lane tracking performance to be unaffected by display configuration; however, speed tracking and overall performance were significantly improved with novel displays, compared to the baseline configuration. Redundantly encoded auditory displays best supported multitracking performance, but redundantly encoded tactile displays were not as beneficial as were simple encodings. These results provide insight into the human information processing of semicontinuous multisensory displays and can inform display design in driving and other visually demanding work contexts.