Extrinsic camera calibration is essential for any computer vision task in a camera network. Usually, researchers place calibration objects in the scene to calibrate the cameras. How- ever, when installing cameras in the field, this approach can be costly and impractical, especially when recalibration is needed. This paper proposes a novel accurate and fully auto- matic extrinsic calibration framework for camera networks with partially overlapping views. It is based on the analysis of pedestrian tracks and does not require calibration objects. Compared to the state of the art, the new method is fully automatic and robust. Our method detect human poses in the camera images and then models walking persons as vertical sticks. We propose a brute-force method to determines the correspondence between persons in multiple camera images. This information along with 3D estimated locations of the head and feet of the pedestrians are then used to compute the extrinsic calibration matrices. We verified the robust- ness of the method in different camera setups and for both single and multiple walking people. The results show that the triangulation error of a few centimeters can be obtained. Typically, it requires 40 seconds of viewing walking people to reach this accuracy in controlled environments and a few minutes for uncontrolled environments. As well as compute relative extrinsic parameters connecting the coordinate sys- tems of cameras in a pairwise fashion automatically. Our proposed method could perform well in various situations such as multi-person, occlusions, or even at real intersections on the street.
Truong, AM, Philips, W, Guan, J, Deligiannis, N & Abrahamyan, L 2019, Automatic extrinsic calibration of camera networks based on pedestrians. in International Conference on Distributed Smart Cameras., 1, Association for Computing Machinery (ACM), pp. 1-6, 13th International Conference on Distributed Smart Cameras (ICDSC 2019), Trento, Italy, 9/09/19. https://doi.org/10.1145/3349801.3349802
Truong, A. M., Philips, W., Guan, J., Deligiannis, N., & Abrahamyan, L. (2019). Automatic extrinsic calibration of camera networks based on pedestrians. In International Conference on Distributed Smart Cameras (pp. 1-6). Article 1 Association for Computing Machinery (ACM). https://doi.org/10.1145/3349801.3349802
@inproceedings{d20cbb19072c4f0e99a1ec27d06486c6,
title = "Automatic extrinsic calibration of camera networks based on pedestrians",
abstract = "Extrinsic camera calibration is essential for any computer vision task in a camera network. Usually, researchers place calibration objects in the scene to calibrate the cameras. How- ever, when installing cameras in the field, this approach can be costly and impractical, especially when recalibration is needed. This paper proposes a novel accurate and fully auto- matic extrinsic calibration framework for camera networks with partially overlapping views. It is based on the analysis of pedestrian tracks and does not require calibration objects. Compared to the state of the art, the new method is fully automatic and robust. Our method detect human poses in the camera images and then models walking persons as vertical sticks. We propose a brute-force method to determines the correspondence between persons in multiple camera images. This information along with 3D estimated locations of the head and feet of the pedestrians are then used to compute the extrinsic calibration matrices. We verified the robust- ness of the method in different camera setups and for both single and multiple walking people. The results show that the triangulation error of a few centimeters can be obtained. Typically, it requires 40 seconds of viewing walking people to reach this accuracy in controlled environments and a few minutes for uncontrolled environments. As well as compute relative extrinsic parameters connecting the coordinate sys- tems of cameras in a pairwise fashion automatically. Our proposed method could perform well in various situations such as multi-person, occlusions, or even at real intersections on the street.",
keywords = "extrinsic calibration, camera network",
author = "Truong, {Anh Minh} and Wilfried Philips and Junzhi Guan and Nikolaos Deligiannis and Lusine Abrahamyan",
year = "2019",
doi = "10.1145/3349801.3349802",
language = "English",
pages = "1--6",
booktitle = "International Conference on Distributed Smart Cameras",
publisher = "Association for Computing Machinery (ACM)",
address = "United States",
note = "13th International Conference on Distributed Smart Cameras (ICDSC 2019), ICDSC 2019 ; Conference date: 09-09-2019 Through 11-09-2019",
url = "https://event.unitn.it/icdsc2019/",
}