Explainable-by-design Semi-Supervised Representation Learning for COVID-19 Diagnosis from CT Imaging ■
Abel Díaz Berenguer,
Abel Díaz Berenguer,
Abel Díaz Berenguer,
Hichem Sahli,
Hichem Sahli,
Hichem Sahli, Boris Joukovsky, Boris Joukovsky, Boris Joukovsky,
Maryna Kvasnytsia,
Maryna Kvasnytsia,
Maryna Kvasnytsia,
Ine Dirks,
Ine Dirks,
Ine Dirks, Mitchel Perez Gonzalez, Mitchel Perez Gonzalez, Mitchel Perez Gonzalez,
Nikos Deligiannis,
Nikos Deligiannis,
Nikos Deligiannis,
Panagiotis Gonidakis,
Panagiotis Gonidakis,
Panagiotis Gonidakis, Sebastián Amador Sánchez, Sebastián Amador Sánchez, Sebastián Amador Sánchez,
Redona Brahimetaj,
Redona Brahimetaj,
Redona Brahimetaj,
Evgenia Papavasileiou,
Evgenia Papavasileiou,
Evgenia Papavasileiou,
Jonathan C-W Chan,
Jonathan C-W Chan,
Jonathan C-W Chan, Fei Li, Fei Li, Fei Li, Shangzhen Song, Shangzhen Song, Shangzhen Song, Yixin Yang, Yixin Yang, Yixin Yang, Sofie Tilborghs, Sofie Tilborghs, Sofie Tilborghs, Siri Willems, Siri Willems, Siri Willems, Tom Eelbode, Tom Eelbode, Tom Eelbode, Jeroen Bertels, Jeroen Bertels, Jeroen Bertels, Dirk Vandermeulen, Dirk Vandermeulen, Dirk Vandermeulen, Frederik Maes, Frederik Maes, Frederik Maes, Paul Suetens, Paul Suetens, Paul Suetens, Lucas Fidon, Lucas Fidon, Lucas Fidon, Tom Vercauteren, Tom Vercauteren, Tom Vercauteren, David Robben, David Robben, David Robben, Arne Brys, Arne Brys, Arne Brys, Dirk Smeets, Dirk Smeets, Dirk Smeets, Bart Ilsen, Bart Ilsen, Bart Ilsen, , , , Nina Watté, Nina Watté, Nina Watté, , , , Annemiek Snoeckx, Annemiek Snoeckx, Annemiek Snoeckx, Paul M. Parizel, Paul M. Parizel, Paul M. Parizel, Julien Guiot, Julien Guiot, Julien Guiot, Louis Deprez, Louis Deprez, Louis Deprez, Paul Meunier, Paul Meunier, Paul Meunier, Stefaan Gryspeerdt, Stefaan Gryspeerdt, Stefaan Gryspeerdt, Kristof De Smet, Kristof De Smet, Kristof De Smet,
Bart Jansen,
Bart Jansen,
Bart Jansen,
Jef Vandemeulebroucke,
Jef Vandemeulebroucke,
Jef Vandemeulebroucke
Our motivating application is a real-world problem: COVID-19 classification from CT imaging, for which we present an explainable Deep Learning approach based on a semi-supervised classification pipeline that employs variational autoencoders to extract efficient feature embedding. We have optimized the architecture of two different networks for CT images: (i) a novel conditional variational autoencoder (CVAE) with a specific architecture that integrates the class labels inside the encoder layers and uses side information with shared attention layers for the encoder, which make the most of the contextual clues for representation learning, and (ii) a downstream convolutional neural network for supervised classification using the encoder structure of the CVAE. With the explainable classification results, the proposed diagnosis system is very effective for COVID-19 classification. Based on the promising results obtained qualitatively and quantitatively, we envisage a wide deployment of our developed technique in large-scale clinical studies.Code is available at https://git.etrovub.be/AVSP/ct-based-covid-19-diagnostic-tool.git.