An android for enhancing social skills and emotion recognition in people with autism

• Published in: IEEE transactions on neural systems and rehabilitation engineering Vol. 13; no. 4; pp. 507 - 515
• Main Authors: Pioggia, G., Igliozzi, R., Ferro, M., Ahluwalia, A., Muratori, F., De Rossi, D.
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.12.2005; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Artificial Intelligence; Autism; Autistic Disorder - complications; Autistic Disorder - psychology; Autistic Disorder - rehabilitation; Automatic control; Biomimetics; Biomimetics - instrumentation; Biomimetics - methods; Child; Control systems; Displays; Emotion recognition; Equipment Design; Equipment Failure Analysis; Expressed Emotion; Face recognition; Facial Expression; Humans; Medical treatment; Pediatrics; Pilot Projects; Protocols; recognition of emotional expressions; robot-based treatment method; Robotics - instrumentation; Robotics - methods; social attention; Social Behavior Disorders - etiology; Social Behavior Disorders - psychology; Social Behavior Disorders - rehabilitation; Therapy, Computer-Assisted - instrumentation; Therapy, Computer-Assisted - methods; User-Computer Interface
• ISSN: 1534-4320; 1558-0210
• DOI: 10.1109/TNSRE.2005.856076

It is well documented that the processing of social and emotional information is impaired in people with autism. Recent studies have shown that individuals, particularly those with high functioning autism, can learn to cope with common social situations if they are made to enact possible scenarios they may encounter in real life during therapy. The main aim of this work is to describe an interactive life-like facial display (FACE) and a supporting therapeutic protocol that will enable us to verify if the system can help children with autism to learn, identify, interpret, and use emotional information and extend these skills in a socially appropriate, flexible, and adaptive context. The therapeutic setup consists of a specially equipped room in which the subject, under the supervision of a therapist, can interact with FACE. The android display and associated control system has automatic facial tracking, expression recognition, and eye tracking. The treatment scheme is based on a series of therapist-guided sessions in which a patient communicates with FACE through an interactive console. Preliminary data regarding the exposure to FACE of two children are reported.