May 17 – 20, 2015
La Biodola, Isola d'Elba
Europe/Rome timezone

A Multi-Modal Fusion Scheme for the Enhancement of PET/MR Viewing

May 18, 2015, 7:20 PM
Room Maria Luisa

Room Maria Luisa

Talk 3 - Advances in MR-PET and MR-SPECT software and quantification Session 4 - Advances in MR-PET and MR-SPECT Software and Quantification


Marco Aiello (IRCCS SDN, Napoli, IT)


PET/MR imaging offers the possibility to achieve in one-shot both functional information provided by PET imaging and morpho-functional information with excellent soft tissue contrast provided by MRI. As a result of a typical PET/MR acquisition, each voxel carries a large amount of multivariate information that can be combined into a single image for a synthetic multi-parametric viewing (image fusion). This work is aimed to explore and introduce a reliable fusion scheme able to blend the useful information carried out from each modality into a single meaningful image. The proposed approach consists of a transformation of the source images followed by a blending and a consecutive reconstruction of fused image into the original domain. Following this scheme, three different transformations of source images (wavelet domain, Fourier domain and identity) and two blending procedures (alpha-blending and gamma-blending) were considered. For a comprehensive assessment of the fusion schemes under investigation, the results were evaluated both qualitatively and quantitatively on a dataset of 60 naturally co-registered FDG-PET/MR studies of different anatomical districts in presence of neurological as well as oncological findings. The quality of fused images was assessed by experts who visually evaluated the loss of useful information with respect to the original modalities. Quantitatively, the information loss was estimated by means of a boundaries-preservation based metric as well as a metric based on mutual information. Preliminary results show that the fusion scheme composed by a wavelet-domain transform and a gamma-blending better depicts useful information of the original modalities. In particular, the proposed approach allows to better unveil the MR signal underlying PET signal in fused images in oncological as well as neurological studies. Furthermore, the use of a gamma-blending procedure ensures the best performances in a fully automated manner.

Primary author

Marco Aiello (IRCCS SDN, Napoli, IT)


Prof. Carlo Cavaliere (IRCCS SDN, Napoli, IT) Dr Emanuele Nicolai (IRCCS SDN, Napoli, IT) Mr Ernesto Forte (IRCCS SDN, Napoli, IT) Prof. Marco Salvatore (IRCCS SDN, Napoli, IT) Ms Marianna Inglese (IRCCS SDN, Napoli, IT) Prof. Onofrio Antonio Catalano (IRCCS SDN, Napoli, IT and Università degli studi di Napoli, Parthenope, IT) Ms Serena Monti (IRCCS SDN, Napoli and Dipartimento di Elettronica, Informazione e Bioingegneria (DEIB), Politecnico di Milano, IT)

Presentation materials

There are no materials yet.