Video Gesture Analysis for Autism Spectrum Disorder Detection

• Published in: 2018 24th International Conference on Pattern Recognition (ICPR) pp. 3421 - 3426
• Main Authors: Zunino, Andrea, Morerio, Pietro, Cavallo, Andrea, Ansuini, Caterina, Podda, Jessica, Battaglia, Francesca, Veneselli, Edvige, Becchio, Cristina, Murino, Vittorio
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.08.2018
• Subjects: Autism; Feature extraction; Medical diagnostic imaging; Psychology; Variable speed drives; Video sequences
• DOI: 10.1109/ICPR.2018.8545095

Autism is a behavioral neurological disorder affecting a significant percentage of worldwide population. It especially starts manifesting at very low ages, but it is difficult to early diagnose it since there is not a specific exam or trial that is able to spot it safely. Its detection is in fact mainly dependent from the medical expertise used to assess the patient behavior during direct interviews. This work aims at providing an automatic objective support to the doctor for the assessment of (early) diagnosis of possible autistic subjects by only using video sequences. The underlying idea and rationale come from the psychological and neuroscience studies claiming that the executions of simple motor acts are different between pathological and healthy subjects, and this can be sufficient to discriminate between them. To this end, we devised an experiment in which we recorded, using a standard video camera, patient and healthy children performing the same simple gesture of grasping a bottle. By only processing the video clips depicting the grasping action using a recurrent deep neural network, we are able to discriminate with a good accuracy between the 2 classes of subjects. The designed deep model is also able to provide a sort of attention map in which the zones in the video of major interest are identified in space and time: this "explains" in a certain way which areas the model deems more relevant to the classification purpose, which could also be used by the doctor to make the diagnosis. In the end, this work constitutes a first step towards the development of an automatic computational system devoted to the early diagnosis of autistic subjects, providing the medical expert of a supportive objective method, potentially simple to use in clinical and also more open settings.