An Intelligent Hand-Assisted Diagnosis System Based on Information Fusion

• Published in: Sensors (Basel, Switzerland) Vol. 24; no. 14; p. 4745
• Main Authors: Li, Haonan, Zhou, Yitong
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 22.07.2024
• Subjects: Algorithms; computer vision; Design; diagnostic system; Disease; Gloves; Injuries; knowledge graph; Medical diagnosis; Patients; Rehabilitation; Robots; Sensors; Silicones; knowledge graph; diagnostic system; computer vision
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s24144745

This research proposes an innovative, intelligent hand-assisted diagnostic system aiming to achieve a comprehensive assessment of hand function through information fusion technology. Based on the single-vision algorithm we designed, the system can perceive and analyze the morphology and motion posture of the patient’s hands in real time. This visual perception can provide an objective data foundation and capture the continuous changes in the patient’s hand movement, thereby providing more detailed information for the assessment and providing a scientific basis for subsequent treatment plans. By introducing medical knowledge graph technology, the system integrates and analyzes medical knowledge information and combines it with a voice question-answering system, allowing patients to communicate and obtain information effectively even with limited hand function. Voice question-answering, as a subjective and convenient interaction method, greatly improves the interactivity and communication efficiency between patients and the system. In conclusion, this system holds immense potential as a highly efficient and accurate hand-assisted assessment tool, delivering enhanced diagnostic services and rehabilitation support for patients.