Object removal and inpainting approaches typically require a user to manually create a mask around occluding objects. While creating masks for a small number of images is possible, it rapidly becomes untenable for longer image sequences. Instead, we accomplish this step automatically using an object detection framework to explicitly recognize and remove several classes of occlusions. We propose using this technique to improve 3D urban reconstruction from street level imagery, in which building facades are frequently occluded by vegetation or vehicles. By assuming facades in the background are planar, 3D scene estimation provides important context to the inpainting process by restricting input sample patches to regions that are coplanar to the occlusion, leading to more realistic final textures. Moreover, because non-static and reflective occlusion classes tend to be difficult to reconstruct, explicitly recognizing and removing them improves the resulting 3D scene.
Engels, C, David, T, Mathias, V, Tuytelaars, T, Sahli, H & Van Gool, L 2011, Automatic Occlusion Removal from Facades for 3D Urban Reconstruction. in LNCS. Springer Verlag, Berlin / Heidelberg, pp. 681-692, Unknown, 1/01/11.
Engels, C., David, T., Mathias, V., Tuytelaars, T., Sahli, H., & Van Gool, L. (2011). Automatic Occlusion Removal from Facades for 3D Urban Reconstruction. In LNCS (pp. 681-692). Springer Verlag.
@inproceedings{2f1cbdf319d54ee08e2bea95d59d5148,
title = "Automatic Occlusion Removal from Facades for 3D Urban Reconstruction",
abstract = "Object removal and inpainting approaches typically require a user to manually create a mask around occluding objects. While creating masks for a small number of images is possible, it rapidly becomes untenable for longer image sequences. Instead, we accomplish this step automatically using an object detection framework to explicitly recognize and remove several classes of occlusions. We propose using this technique to improve 3D urban reconstruction from street level imagery, in which building facades are frequently occluded by vegetation or vehicles. By assuming facades in the background are planar, 3D scene estimation provides important context to the inpainting process by restricting input sample patches to regions that are coplanar to the occlusion, leading to more realistic final textures. Moreover, because non-static and reflective occlusion classes tend to be difficult to reconstruct, explicitly recognizing and removing them improves the resulting 3D scene.",
keywords = "3D Urban Reconstruction",
author = "C. Engels and Tingdahl David and Vercruysse Mathias and Tinne Tuytelaars and Hichem Sahli and {Van Gool}, Luc",
year = "2011",
language = "English",
isbn = "978-3-642-23687-7",
pages = "681--692",
booktitle = "LNCS",
publisher = "Springer Verlag",
address = "Germany",
note = "Unknown ; Conference date: 01-01-2011",
}