Realistic morphology-preserving generative modelling of the brain

• Published in: Nature machine intelligence Vol. 6; no. 7; pp. 811 - 819
• Main Authors: Tudosiu, Petru-Daniel, Pinaya, Walter H. L., Ferreira Da Costa, Pedro, Dafflon, Jessica, Patel, Ashay, Borges, Pedro, Fernandez, Virginia, Graham, Mark S., Gray, Robert J., Nachev, Parashkev, Ourselin, Sebastien, Cardoso, M. Jorge
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 01.07.2024; Nature Publishing Group
• Subjects: 639/705/117; 692/308/575; Algorithms; Anomalies; Availability; Biobanks; Brain; Datasets; Deep learning; Demographics; Engineering; Genotype & phenotype; High resolution; Image acquisition; Image analysis; Image resolution; Machine learning; Medical electronics; Medical imaging; Medical research; Morphology; Neuroimaging; Realism; Synthesis; United Kingdom > UK; Computer science; Translational research
• ISSN: 2522-5839; 2522-5839
• DOI: 10.1038/s42256-024-00864-0

Medical imaging research is often limited by data scarcity and availability. Governance, privacy concerns and the cost of acquisition all restrict access to medical imaging data, which, compounded by the data-hungry nature of deep learning algorithms, limits progress in the field of healthcare AI. Generative models have recently been used to synthesize photorealistic natural images, presenting a potential solution to the data scarcity problem. But are current generative models synthesizing morphologically correct samples? In this work we present a three-dimensional generative model of the human brain that is trained at the necessary scale to generate diverse, realistic-looking, high-resolution and morphologically preserving samples and conditioned on patient characteristics (for example, age and pathology). We show that the synthetic samples generated by the model preserve biological and disease phenotypes and are realistic enough to permit use downstream in well-established image analysis tools. While the proposed model has broad future applicability, such as anomaly detection and learning under limited data, its generative capabilities can be used to directly mitigate data scarcity, limited data availability and algorithmic fairness. Medical imaging research is limited by data availability. To address this challenge, Tudosiu and colleagues develop a 3D generative model of the human brain that can generate high-resolution morphologically correct brains conditioned on patient characteristics.