System Architecture for VR Yoga Therapy Platform with 6-DoF Whole-Body Avatar Tracking

• Published in: IEEE International Conference on Artificial Intelligence and Virtual Reality (Online) Vol. 2024; pp. 360 - 366
• Main Authors: Kupin, Alexander Ah, Banerjee, Sean, Banerjee, Natasha, Roy, Serge H, Kline, Joshua C, Shiwani, Bhawna
• Format: Conference Proceeding Journal Article
• Language: English
• Published: United States IEEE 2024
• Subjects: Avatars; Biomechanically Driven Avatars; Medical treatment; Pain; Pediatric Pain; Real-time systems; Rendering (computer graphics); Solid modeling; Tracking; VR Rehabilitation; Yoga Therapy; Pediatric Pain; VR Rehabilitation; Virtual reality; Biomechanically Driven Avatars; Human-centered computing; Human computer interaction (HCI); Interaction paradigms; Yoga Therapy
• ISSN: 2771-7453; 2771-7453
• DOI: 10.1109/AIxVR59861.2024.00062

Chronic pain is a leading cause of morbidity among children and adolescents affecting 35% of the global population. Pediatric chronic pain management requires integrative health methods spanning physical and psychological subsystems through various mind-body interventions. Yoga therapy is one such method, known for its ability to improve the quality of life both physically and psychologically in chronic pain conditions. However, maintaining the clinical outcomes of personalized yoga therapy sessions at-home is challenging due to fear of movement, lack of motivation, and boredom. Virtual Reality (VR) has the potential to bridge the gap between the clinic and home by motivating engagement and mitigating pain-related anxiety or fear of movement. We developed a multi-modal algorithmic architecture for fusing real-time 3D human body pose estimation models with custom developed inverse kinematics models of physical movement to render biomechanically informed 6-DoF whole-body avatars capable of embodying an individual's real-time yoga poses within the VR environment. Experiments conducted among control participants demonstrated superior movement tracking accuracy over existing commercial off-the-shelf avatar tracking solutions, leading to successful embodiment and engagement. These findings demonstrate the feasibility of rendering virtual avatar movements that embody complex physical poses such as those encountered in yoga therapy. The impact of this work moves the field one step closer to an interactive system to facilitate at-home individual or group yoga therapy for children with chronic pain conditions.