ETRO VUB
About ETRO  |  News  |  Events  |  Vacancies  |  Contact  
Home Research Education Industry Publications About ETRO

ETRO Publications

Full Details

Conference Publication

Designing CNNs for Multimodal Image Super-Resolution via the Method of Multipliers

Host Publication: 28th European Signal Processing Conference

Authors: I. Marivani, E. Tsiligianni, B. Cornelis and N. Deligiannis

Publisher: IEEE

Publication Year: 2020

Number of Pages: 5


Abstract:

Multimodal alias, guided, image super-resolution(SR) refers to the reconstruction of a high-resolution (HR) version of a low-resolution (LR) image with the aid of an HR image from another image modality. Common approaches for the SR problem include analytical methods which are computationally expensive.Deep learning methods are capable of learning a nonlinear mapping between LR and HR images from data, delivering high reconstruction accuracy at a low-computational cost during inference however, these methods do not incorporate any prior knowledge about the problem, with the neural network model behaving like a black box. In this paper, we formulate multimodal image SR as a coupled convolutional sparse coding problem.To solve the corresponding minimization problem, we adopt theMethod of Multipliers (MM). We then design a convolutional neural network (CNN) that unfolds the obtained MM algorithm.The proposed CNN accepts as input the LR image from the main modality and the HR image from the guidance modality to reconstruct the desired HR image. Unlike existing deep learning methods, our CNN provides an efficient and structured way to fuse information at different stages of the network and achieves high reconstruction accuracy. We evaluate the performance of the proposed model for the super-resolution of multi-spectral images guided by their high resolution RGB counterparts.

Other Reference Styles
Current ETRO Authors

Mr. Iman Marivani

+32 (0)02 629 167

imarivan@etrovub.be

more info

Dr. Ir. Bruno Cornelis

+32 (0)02 629 167

bcorneli@etrovub.be

more info

Prof. Dr. Ir. Nikolaos Deligiannis

+32 (0)02 629 168

ndeligia@etrovub.be

more info

Other Publications

• Journal publications

IRIS • LAMI • AVSP

• Conference publications

IRIS • LAMI • AVSP

• Book publications

IRIS • LAMI • AVSP

• Reports

IRIS • LAMI • AVSP

• Laymen publications

IRIS • LAMI • AVSP

• PhD Theses

Search ETRO Publications

Author:

Keyword:  

Type:








- Contact person

- IRIS

- AVSP

- LAMI

- Contact person

- Thesis proposals

- ETRO Courses

- Contact person

- Spin-offs

- Know How

- Journals

- Conferences

- Books

- Vacancies

- News

- Events

- Press

Contact

ETRO Department

Tel: +32 2 629 29 30

©2022 • Vrije Universiteit Brussel • ETRO Dept. • Pleinlaan 2 • 1050 Brussels • Tel: +32 2 629 2930 (secretariat) • Fax: +32 2 629 2883 • WebmasterDisclaimer