Light field cameras capture information about the incoming light from multiple directions, going beyond classical capturing of light intensity performed by regular RGB cameras. This enables the computation of more accurate depth maps compared to stereo methods based on conventional cameras. However, the very small angular resolution of light field cameras limits their practical use in 3D applications. In this paper, we introduce for the first time in the literature the use of light field camera arrays, with the aim of improving the depth maps while providing a wide field of view. In this context, a novel algorithm for multi-stereo matching based on light field camera arrays is proposed. The disparity maps for the sub-aperture images are computed based on light field camera pairs using a novel multi-scale and multi-window stereo-matching algorithm. A global energy minimization based on belief propagation is proposed to regularize the results. The resulting depth maps are efficiently fused by means of k-means clustering. The proposed approach demonstrates very promising results for accurate 3D scene reconstruction and free navigation applications.
Rogge, S, Ceulemans, B, Bolsée, Q & Munteanu, A 2018, Multi-stereo Matching for Light Field Camera Arrays. in 2018 26th European Signal Processing Conference, EUSIPCO 2018: EUSIPCO 2018., 8553075, European Signal Processing Conference, vol. 2018-September, IEEE, pp. 251-255, 26th European Signal Processing Conference, Rome, Italy, 3/09/18. https://doi.org/10.23919/EUSIPCO.2018.8553075
Rogge, S., Ceulemans, B., Bolsée, Q., & Munteanu, A. (2018). Multi-stereo Matching for Light Field Camera Arrays. In 2018 26th European Signal Processing Conference, EUSIPCO 2018: EUSIPCO 2018 (pp. 251-255). Article 8553075 (European Signal Processing Conference; Vol. 2018-September). IEEE. https://doi.org/10.23919/EUSIPCO.2018.8553075
@inproceedings{e6f121a2d4374a58a8f7a424eb691663,
title = "Multi-stereo Matching for Light Field Camera Arrays",
abstract = "Light field cameras capture information about the incoming light from multiple directions, going beyond classical capturing of light intensity performed by regular RGB cameras. This enables the computation of more accurate depth maps compared to stereo methods based on conventional cameras. However, the very small angular resolution of light field cameras limits their practical use in 3D applications. In this paper, we introduce for the first time in the literature the use of light field camera arrays, with the aim of improving the depth maps while providing a wide field of view. In this context, a novel algorithm for multi-stereo matching based on light field camera arrays is proposed. The disparity maps for the sub-aperture images are computed based on light field camera pairs using a novel multi-scale and multi-window stereo-matching algorithm. A global energy minimization based on belief propagation is proposed to regularize the results. The resulting depth maps are efficiently fused by means of k-means clustering. The proposed approach demonstrates very promising results for accurate 3D scene reconstruction and free navigation applications.",
author = "S{\'e}gol{\`e}ne Rogge and Beerend Ceulemans and Quentin Bols{\'e}e and Adrian Munteanu",
year = "2018",
month = nov,
day = "29",
doi = "10.23919/EUSIPCO.2018.8553075",
language = "English",
series = "European Signal Processing Conference",
publisher = "IEEE",
pages = "251--255",
booktitle = "2018 26th European Signal Processing Conference, EUSIPCO 2018",
note = "26th European Signal Processing Conference ; Conference date: 03-09-2018 Through 07-09-2018",
url = "http://www.eusipco2018.org/",
}