Regressing heatmaps for multiple landmark localization using CNNs

C Payer, D Štern, H Bischof, M Urschler - International conference on …, 2016 - Springer
International conference on medical image computing and computer-assisted …, 2016Springer
We explore the applicability of deep convolutional neural networks (CNNs) for multiple
landmark localization in medical image data. Exploiting the idea of regressing heatmaps for
individual landmark locations, we investigate several fully convolutional 2D and 3D CNN
architectures by training them in an end-to-end manner. We further propose a novel
SpatialConfiguration-Net architecture that effectively combines accurate local appearance
responses with spatial landmark configurations that model anatomical variation. Evaluation …
Abstract
We explore the applicability of deep convolutional neural networks (CNNs) for multiple landmark localization in medical image data. Exploiting the idea of regressing heatmaps for individual landmark locations, we investigate several fully convolutional 2D and 3D CNN architectures by training them in an end-to-end manner. We further propose a novel SpatialConfiguration-Net architecture that effectively combines accurate local appearance responses with spatial landmark configurations that model anatomical variation. Evaluation of our different architectures on 2D and 3D hand image datasets show that heatmap regression based on CNNs achieves state-of-the-art landmark localization performance, with SpatialConfiguration-Net being robust even in case of limited amounts of training data.
Springer