Keelin Murphy, Keelin Murphy, Bram van Ginneken, Bram van Ginneken, Joseph M Reinhardt, Joseph M Reinhardt, Sven Kabus, Sven Kabus, Kai Ding, Kai Ding, Xiang Deng, Xiang Deng, Kunlin Cao, Kunlin Cao, Kaifang Du, Kaifang Du, Gary E Christensen, Gary E Christensen, Vincent Garcia, Vincent Garcia, Tom Vercauteren, Tom Vercauteren, Nicholas Ayache, Nicholas Ayache, Olivier Commowick, Olivier Commowick, Grégoire Malandain, Grégoire Malandain, Ben Glocker, Ben Glocker, Nikos Paragios, Nikos Paragios, Nassir Navab, Nassir Navab, Vladlena Gorbunova, Vladlena Gorbunova, Jon Sporring, Jon Sporring, Marleen de Bruijne, Marleen de Bruijne, Xiao Han, Xiao Han, Mattias P Heinrich, Mattias P Heinrich, Julia A Schnabel, Julia A Schnabel, Mark Jenkinson, Mark Jenkinson, Cristian Lorenz, Cristian Lorenz, Marc Modat, Marc Modat, Jamie R McClelland, Jamie R McClelland, Sébastien Ourselin, Sébastien Ourselin, Sascha E A Muenzing, Sascha E A Muenzing, Max A Viergever, Max A Viergever, Dante De Nigris, Dante De Nigris, D Louis Collins, D Louis Collins, Tal Arbel, Tal Arbel, Marta Peroni, Marta Peroni, Rui Li, Rui Li, Gregory C Sharp, Gregory C Sharp, Alexander Schmidt-Richberg, Alexander Schmidt-Richberg, Jan Ehrhardt, Jan Ehrhardt, René Werner, René Werner, Dirk Smeets, Dirk Smeets, Dirk Loeckx, Dirk Loeckx, Gang Song, Gang Song, Nicholas Tustison, Nicholas Tustison, Brian Avants, Brian Avants, James C Gee, James C Gee, Marius Staring, Marius Staring, Stefan Klein, Stefan Klein, Berend C Stoel, Berend C Stoel, Martin Urschler, Martin Urschler, Manuel Werlberger, Manuel Werlberger,
Jef Vandemeulebroucke,
Jef Vandemeulebroucke, Simon Rit, Simon Rit, David Sarrut, David Sarrut, Josien P W Pluim, Josien P W Pluim
EMPIRE10 (Evaluation of Methods for Pulmonary Image REgistration 2010) is a public platform for fair and meaningful comparison of registration algorithms which are applied to a database of intrapatient thoracic CT image pairs. Evaluation of nonrigid registration techniques is a nontrivial task. This is compounded by the fact that researchers typically test only on their own data, which varies widely. For this reason, reliable assessment and comparison of different registration algorithms has been virtually impossible in the past. In this work we present the results of the launch phase of EMPIRE10, which comprised the comprehensive evaluation and comparison of 20 individual algorithms from leading academic and industrial research groups. All algorithms are applied to the same set of 30 thoracic CT pairs. Algorithm settings and parameters are chosen by researchers expert in the configuration of their own method and the evaluation is independent, using the same criteria for all participants. All results are published on the EMPIRE10 website (http://empire10.isi.uu.nl). The challenge remains ongoing and open to new participants. Full results from 24 algorithms have been published at the time of writing. This paper details the organization of the challenge, the data and evaluation methods and the outcome of the initial launch with 20 algorithms. The gain in knowledge and future work are discussed.
Murphy, K, van Ginneken, B, Reinhardt, JM, Kabus, S, Ding, K, Deng, X, Cao, K, Du, K, Christensen, GE, Garcia, V, Vercauteren, T, Ayache, N, Commowick, O, Malandain, G, Glocker, B, Paragios, N, Navab, N, Gorbunova, V, Sporring, J, de Bruijne, M, Han, X, Heinrich, MP, Schnabel, JA, Jenkinson, M, Lorenz, C, Modat, M, McClelland, JR, Ourselin, S, Muenzing, SEA, Viergever, MA, De Nigris, D, Collins, DL, Arbel, T, Peroni, M, Li, R, Sharp, GC, Schmidt-Richberg, A, Ehrhardt, J, Werner, R, Smeets, D, Loeckx, D, Song, G, Tustison, N, Avants, B, Gee, JC, Staring, M, Klein, S, Stoel, BC, Urschler, M, Werlberger, M, Vandemeulebroucke, J, Rit, S, Sarrut, D & Pluim, JPW 2011, 'Evaluation of registration methods on thoracic CT: the EMPIRE10 challenge', IEEE Transactions on Medical Imaging, vol. 30, no. 11, pp. 1901-1920. https://doi.org/10.1109/TMI.2011.2158349
Murphy, K., van Ginneken, B., Reinhardt, J. M., Kabus, S., Ding, K., Deng, X., Cao, K., Du, K., Christensen, G. E., Garcia, V., Vercauteren, T., Ayache, N., Commowick, O., Malandain, G., Glocker, B., Paragios, N., Navab, N., Gorbunova, V., Sporring, J., ... Pluim, J. P. W. (2011). Evaluation of registration methods on thoracic CT: the EMPIRE10 challenge. IEEE Transactions on Medical Imaging, 30(11), 1901-1920. https://doi.org/10.1109/TMI.2011.2158349
@article{abbed03b81024df3a14e2bf5964f410a,
title = "Evaluation of registration methods on thoracic CT: the EMPIRE10 challenge",
abstract = "EMPIRE10 (Evaluation of Methods for Pulmonary Image REgistration 2010) is a public platform for fair and meaningful comparison of registration algorithms which are applied to a database of intrapatient thoracic CT image pairs. Evaluation of nonrigid registration techniques is a nontrivial task. This is compounded by the fact that researchers typically test only on their own data, which varies widely. For this reason, reliable assessment and comparison of different registration algorithms has been virtually impossible in the past. In this work we present the results of the launch phase of EMPIRE10, which comprised the comprehensive evaluation and comparison of 20 individual algorithms from leading academic and industrial research groups. All algorithms are applied to the same set of 30 thoracic CT pairs. Algorithm settings and parameters are chosen by researchers expert in the configuration of their own method and the evaluation is independent, using the same criteria for all participants. All results are published on the EMPIRE10 website (http://empire10.isi.uu.nl). The challenge remains ongoing and open to new participants. Full results from 24 algorithms have been published at the time of writing. This paper details the organization of the challenge, the data and evaluation methods and the outcome of the initial launch with 20 algorithms. The gain in knowledge and future work are discussed.",
keywords = "Algorithms, Animals, Databases, Factual, Lung, Observer Variation, Radiographic Image Enhancement, Radiographic Image Interpretation, Computer-Assisted, Radiography, Thoracic, Reference Standards, Reproducibility of Results, Sensitivity and Specificity, Sheep, Software Validation, Thorax, Tomography, X-Ray Computed",
author = "Keelin Murphy and \{van Ginneken\}, Bram and Reinhardt, \{Joseph M\} and Sven Kabus and Kai Ding and Xiang Deng and Kunlin Cao and Kaifang Du and Christensen, \{Gary E\} and Vincent Garcia and Tom Vercauteren and Nicholas Ayache and Olivier Commowick and Gr{\'e}goire Malandain and Ben Glocker and Nikos Paragios and Nassir Navab and Vladlena Gorbunova and Jon Sporring and \{de Bruijne\}, Marleen and Xiao Han and Heinrich, \{Mattias P\} and Schnabel, \{Julia A\} and Mark Jenkinson and Cristian Lorenz and Marc Modat and McClelland, \{Jamie R\} and S{\'e}bastien Ourselin and Muenzing, \{Sascha E A\} and Viergever, \{Max A\} and \{De Nigris\}, Dante and Collins, \{D Louis\} and Tal Arbel and Marta Peroni and Rui Li and Sharp, \{Gregory C\} and Alexander Schmidt-Richberg and Jan Ehrhardt and Ren{\'e} Werner and Dirk Smeets and Dirk Loeckx and Gang Song and Nicholas Tustison and Brian Avants and Gee, \{James C\} and Marius Staring and Stefan Klein and Stoel, \{Berend C\} and Martin Urschler and Manuel Werlberger and Jef Vandemeulebroucke and Simon Rit and David Sarrut and Pluim, \{Josien P W\}",
year = "2011",
month = nov,
doi = "10.1109/TMI.2011.2158349",
language = "English",
volume = "30",
pages = "1901--1920",
journal = "IEEE Transactions on Medical Imaging",
issn = "0278-0062",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "11",
}