PRISM: An open source framework for the interactive design of GPU volume rendering shaders

• Published in: PloS one Vol. 13; no. 3; p. e0193636
• Main Authors: Drouin, Simon, Collins, D. Louis
• Format: Journal Article
• Language: English
• Published: United States Public Library of Science 13.03.2018; Public Library of Science (PLoS)
• Subjects: Augmented reality; Biology and Life Sciences; Communities; Computer and Information Sciences; Computer assisted image interpretation; Computer graphics; Depth perception; Diagnostic imaging; Digital video recorders; Engineering and Technology; Engineering research; Graphical user interface; Graphics processing units; Integration; Internet; Medical imaging; Medical imaging equipment; Medical research; Medicine and Health Sciences; Occlusion; Photonics; Physical Sciences; Rapid prototyping; Rendering; Research and Analysis Methods; Researchers; Science Policy; Shaders; Shading; Social Sciences; Usability; Visualization; Canada; New York; Montreal Quebec Canada; United States > US; Quebec Canada
• ISSN: 1932-6203; 1932-6203
• DOI: 10.1371/journal.pone.0193636

Direct volume rendering has become an essential tool to explore and analyse 3D medical images. Despite several advances in the field, it remains a challenge to produce an image that highlights the anatomy of interest, avoids occlusion of important structures, provides an intuitive perception of shape and depth while retaining sufficient contextual information. Although the computer graphics community has proposed several solutions to address specific visualization problems, the medical imaging community still lacks a general volume rendering implementation that can address a wide variety of visualization use cases while avoiding complexity. In this paper, we propose a new open source framework called the Programmable Ray Integration Shading Model, or PRISM, that implements a complete GPU ray-casting solution where critical parts of the ray integration algorithm can be replaced to produce new volume rendering effects. A graphical user interface allows clinical users to easily experiment with pre-existing rendering effect building blocks drawn from an open database. For programmers, the interface enables real-time editing of the code inside the blocks. We show that in its default mode, the PRISM framework produces images very similar to those produced by a widely-adopted direct volume rendering implementation in VTK at comparable frame rates. More importantly, we demonstrate the flexibility of the framework by showing how several volume rendering techniques can be implemented in PRISM with no more than a few lines of code. Finally, we demonstrate the simplicity of our system in a usability study with 5 medical imaging expert subjects who have none or little experience with volume rendering. The PRISM framework has the potential to greatly accelerate development of volume rendering for medical applications by promoting sharing and enabling faster development iterations and easier collaboration between engineers and clinical personnel.