Objective quality assessment of digital holograms has proven to be a challenging task. While prediction of perceptual quality of the recorded 3D content from the holographic wavefield is an open problem; perceptual quality assessment from content after rendering, requires a time-consuming rendering step and a multitude of possible viewports. In this research, we use 96 Fourier holograms of the recently released HoloDB database to evaluate the performance of well-known and state-of-the-art image quality metrics on digital holograms. We compare the reference holograms with their distorted versions: (i) before rendering on the real and imaginary parts of the quantized complex-wavefield, (ii) after converting Fourier to Fresnel holograms, (iii) after rendering, on the quantized amplitude of the reconstructed data, and (iv) after subsequently removing speckle noise using a Wiener filter. For every experimental track, the quality metric predictions are compared to the Mean Opinion Scores (MOS) gathered on a 2D screen, light field display and a holographic display. Additionally, a statistical analysis of the results and a discussion on the performance of the metrics are presented. The tests demonstrate that while for each test track a few quality metrics present a highly correlated performance compared to the multiple sets of available MOS, none of them demonstrates a consistently high-performance across all four test-tracks.
Ahar, A, Birnbaum, T, Chlipala, M, Zaperty, W, Mahmoudpour, S, Kozacki, T, Kujawinska, M & Schelkens, P 2021, 'Comprehensive Performance Analysis of Objective Quality Metrics for Digital Holography', Signal Processing: Image Communication, vol. 97, no. 0923-5965, 116361, pp. 116361. https://doi.org/10.1016/j.image.2021.116361
Ahar, A., Birnbaum, T., Chlipala, M., Zaperty, W., Mahmoudpour, S., Kozacki, T., Kujawinska, M., & Schelkens, P. (2021). Comprehensive Performance Analysis of Objective Quality Metrics for Digital Holography. Signal Processing: Image Communication, 97(0923-5965), 116361. Article 116361. https://doi.org/10.1016/j.image.2021.116361
@article{7d21407cc24944eb895421ffc932bcc6,
title = "Comprehensive Performance Analysis of Objective Quality Metrics for Digital Holography",
abstract = "Objective quality assessment of digital holograms has proven to be a challenging task. While prediction of perceptual quality of the recorded 3D content from the holographic wavefield is an open problem; perceptual quality assessment from content after rendering, requires a time-consuming rendering step and a multitude of possible viewports. In this research, we use 96 Fourier holograms of the recently released HoloDB database to evaluate the performance of well-known and state-of-the-art image quality metrics on digital holograms. We compare the reference holograms with their distorted versions: (i) before rendering on the real and imaginary parts of the quantized complex-wavefield, (ii) after converting Fourier to Fresnel holograms, (iii) after rendering, on the quantized amplitude of the reconstructed data, and (iv) after subsequently removing speckle noise using a Wiener filter. For every experimental track, the quality metric predictions are compared to the Mean Opinion Scores (MOS) gathered on a 2D screen, light field display and a holographic display. Additionally, a statistical analysis of the results and a discussion on the performance of the metrics are presented. The tests demonstrate that while for each test track a few quality metrics present a highly correlated performance compared to the multiple sets of available MOS, none of them demonstrates a consistently high-performance across all four test-tracks. ",
keywords = "Digital Holography, Objective quality assessment",
author = "Ayyoub Ahar and Tobias Birnbaum and Maksymilian Chlipala and Weronika Zaperty and Saeed Mahmoudpour and Tomasz Kozacki and Malgorzata Kujawinska and Peter Schelkens",
note = "Funding Information: The research leading to these results has received funding from the European Research Council under the European Union's Seventh Framework Programme (FP7/2007-2013)/ERC Grant Agreement n. 617779 (INTERFERE) and also the Cross-Ministry Giga KOREA Project (GigaKOREA GK20D0100) and the support from the WUT, China. Funding Information: The research leading to these results has received funding from the European Research Council under the European Union\u2019s Seventh Framework Programme (FP7/2007-2013)/ERC Grant Agreement n. 617779 (INTERFERE) and also the Cross-Ministry Giga KOREA Project (GigaKOREA GK20D0100 ) and the support from the WUT, China . Publisher Copyright: {\textcopyright} 2021",
year = "2021",
month = sep,
day = "21",
doi = "10.1016/j.image.2021.116361",
language = "English",
volume = "97",
pages = "116361",
journal = "Signal Processing: Image Communication",
issn = "0923-5965",
publisher = "Elsevier",
number = "0923-5965",
}