A Segmentation Based Robust Deep Learning Framework for Multimodal Retinal Image Registration

Multimodal image registration plays an important role in diagnosing and treating ophthalmologic diseases. In this paper, a deep learning framework for multimodal retinal image registration is proposed. The framework consists of a segmentation network, feature detection and description network, and an outlier rejection network, which focuses only on the globally coarse alignment step using the perspective transformation. We apply the proposed framework to register color fundus images with infrared reflectance images and compare it with the state-of-the-art conventional and learning-based approaches. The proposed framework demonstrates a significant improvement in robustness and accuracy reflected by a higher success rate and Dice coefficient compared to other coarse alignment methods.

Download paper here

Citation:

@inproceedings{wang2020segmentation,
  title={A Segmentation Based Robust Deep Learning Framework for Multimodal Retinal Image Registration},
  author={Wang, Yiqian and Zhang, Junkang and An, Cheolhong and Cavichini, Melina and Jhingan, Mahima and Amador-Patarroyo, Manuel J and Long, Christopher P and Bartsch, Dirk-Uwe G and Freeman, William R and Nguyen, Truong Q},
  booktitle={ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
  pages={1369--1373},
  year={2020},
  organization={IEEE}
}