This paper presents a correlation filter object tracker based on fast spatial-spectral features (FSSF) to realize robust, real-time object tracking in hyperspectral surveillance video. Traditional object tracking in surveillance video based only on appearance information often fails in the presence of background clutter, low resolution, and appearance changes. Hyperspectral imaging uses unique spectral properties as well as spatial information to improve tracking accuracy in such challenging environments. However, the high-dimensionality of hyperspectral images causes high computational costs and difficulties for discriminative feature extraction. In FSSF, the real-time spatial-spectral convolution (RSSC) kernel is updated in real time in the Fourier transform domain without offline training to quickly extract discriminative spatial-spectral features. The spatial-spectral features are integrated into correlation filters to complete the hyperspectral tracking. To validate the proposed scheme, we collected a hyperspectral surveillance video (HSSV) dataset consisting of 70 sequences in 25 bands. Extensive experiments confirm the advantages and the efficiency of the proposed FSSF for object tracking in hyperspectral video tracking in challenging conditions of background clutter, low resolution, and appearance changes.
Lulu, C, zhao, Y, Yao, J, Chen, J, Li, N, Chan, JC-W & Kong, SG 2021, 'Object Tracking in Hyperspectral-Oriented Video with Fast Spatial-Spectral Features', Remote Sensing, vol. 13, no. 10, 1922. https://doi.org/10.3390/rs13101922
Lulu, C., zhao, Y., Yao, J., Chen, J., Li, N., Chan, J. C.-W., & Kong, S. G. (2021). Object Tracking in Hyperspectral-Oriented Video with Fast Spatial-Spectral Features. Remote Sensing, 13(10), Article 1922. https://doi.org/10.3390/rs13101922
@article{4d592db73f89443faa104a90f95efb96,
title = "Object Tracking in Hyperspectral-Oriented Video with Fast Spatial-Spectral Features",
abstract = "This paper presents a correlation filter object tracker based on fast spatial-spectral features (FSSF) to realize robust, real-time object tracking in hyperspectral surveillance video. Traditional object tracking in surveillance video based only on appearance information often fails in the presence of background clutter, low resolution, and appearance changes. Hyperspectral imaging uses unique spectral properties as well as spatial information to improve tracking accuracy in such challenging environments. However, the high-dimensionality of hyperspectral images causes high computational costs and difficulties for discriminative feature extraction. In FSSF, the real-time spatial-spectral convolution (RSSC) kernel is updated in real time in the Fourier transform domain without offline training to quickly extract discriminative spatial-spectral features. The spatial-spectral features are integrated into correlation filters to complete the hyperspectral tracking. To validate the proposed scheme, we collected a hyperspectral surveillance video (HSSV) dataset consisting of 70 sequences in 25 bands. Extensive experiments confirm the advantages and the efficiency of the proposed FSSF for object tracking in hyperspectral video tracking in challenging conditions of background clutter, low resolution, and appearance changes.",
author = "Chen Lulu and yongqiang zhao and Jiaxin Yao and Jiaxin Chen and Ning Li and Chan, {Jonathan Cheung-Wai} and Kong, {Seong G}",
note = "Funding Information: Funding: This research was funded by the National Natural Science Foundation of China (NSFC) (No. 61771391), the Key R & D plan of Shaanxi Province (No. 2020ZDLGY07-11), the Science, Technology and Innovation Commission of Shenzhen Municipality (No. JCYJ20170815162956949, CYJ20180306171146740), the Natural Science basic Research Plan in Shaanxi Province of China (No. 2018JM6056), the faculty research fund of Sejong University in 2021 (No. Sejong-2021). Publisher Copyright: {\textcopyright} 2021 by the authors. Licensee MDPI, Basel, Switzerland.",
year = "2021",
month = may,
doi = "10.3390/rs13101922",
language = "English",
volume = "13",
journal = "Remote Sensing",
issn = "2072-4292",
publisher = "Torrent Valencia: Recent Advances, [2024]-",
number = "10",
}