Deep Labeling of fMRI Brain Networks Using Cloud Based Processing

• Published in: Advances in Visual Computing Vol. 13598; pp. 275 - 283
• Main Authors: Ghate, Sejal, Santamaria-Pang, Alberto, Tarapov, Ivan, Sair, Haris, Jones, Craig
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2022; Springer International Publishing
• Series: Lecture Notes in Computer Science
• Subjects: AzureML; Independent component analysis; Neural network classification; Resting state fMRI
• ISBN: 9783031207129; 3031207122
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-031-20713-6_21

Resting state fMRI is an imaging modality which reveals brain activity localization through signal changes, in what is known as Resting State Networks (RSNs). This technique is gaining popularity in neurosurgical pre-planning to visualize the functional regions and assess regional activity. Labeling of rs-fMRI networks require subject-matter expertise and is time consuming, creating a need for an automated classification algorithm. While the impact of AI in medical diagnosis has shown great progress; deploying and maintaining these in a clinical setting is an unmet need. We propose an end-to-end reproducible pipeline which incorporates image processing of rs-fMRI in a cloud-based workflow while using deep learning to automate the classification of RSNs. We have architected a reproducible Azure Machine Learning cloud-based medical imaging concept pipeline for fMRI analysis integrating the popular FMRIB Software Library (FSL) toolkit. To demonstrate a clinical application using a large dataset, we compare three neural network architectures for classification of deeper RSNs derived from processed rs-fMRI. The three algorithms are: an MLP, a 2D projection-based CNN, and a fully 3D CNN classification networks. Each of the networks was trained on the rs-fMRI back-projected independent components giving > 98% accuracy for each classification method.