Features extraction from human eye movements via echo state network

• Published in: Neural computing & applications Vol. 32; no. 9; pp. 4213 - 4226
• Main Authors: Koprinkova-Hristova, Petia, Stefanova, Miroslava, Genova, Bilyana, Bocheva, Nadejda, Kraleva, Radoslava, Kralev, Velin
• Format: Journal Article
• Language: English
• Published: London Springer London 01.05.2020; Springer Nature B.V
• Subjects: Artificial Intelligence; Classification; Computational Biology/Bioinformatics; Computational Science and Engineering; Computer Science; Data Mining and Knowledge Discovery; Decision making; Emerging Trends of Applied Neural Computation - E_TRAINCO; Eye movements; Feature extraction; Image Processing and Computer Vision; Probability and Statistics in Computer Science; Reservoirs; State vectors; Stimulation; Time series; Echo state network; Eye tracking; Time series; Classification
• ISSN: 0941-0643; 1433-3058
• DOI: 10.1007/s00521-019-04329-z

The paper develops a procedure for features extraction from eye movement’s time series aimed at age-related classification of humans. It exploits the properties of the echo state network (ESN) reservoir state achieved after its intrinsic plasticity tuning. A novel, recently proposed approach for ranking of dynamic data series using as single feature the length of the reservoir state vector reached after consecutive feeding of each time series into the ESN was investigated in details using eye tracker recordings of human eye movements during visual stimulation and decision-making process. Inclusion of other features like variance of ESN extracted feature for multiple similar stimulations as well as decision correctness allowed for better classification of test subjects. The results support the view that the metrics and dynamics of the eye movements depend little on age, though they are strongly related to the visual stimulation characteristics.