Emotion plays a significant role in human-computer interaction. The continuing improvements in speech technology have let to many new and fascinating applications in human-computer interaction, context aware computing and computer mediated communication. Such applications require reliable online recognition of the user's affect. However most emotion recognition systems are based son speech via an isolated short sentence or word. We present a framework for online emotion recognition from speech. On the front-end, a voice activity detection algorithm is used to segment the input speech, and feature are estimated to model long-term properties. Then, dimensional and continuous emotion recognition is performed via a Relevance Units Machine (RUM). The advantages of the proposed systems are: (i) its computational efficiency in run-time (regression outputs can be produced continuously in pseudo real-time), (ii) RUM offers superior sparsity to the well-known Support Vector Regression (SVR) and Relevance Vector Machine for regression (RVR), and (iii) RUM's predictive performance is comparable to SVR and RVR.
Wang, F, Sahli, H, Gao, J, Jiang, D & Verhelst, W 2015, 'Relevance Units Machine based Dimensional and Continuous Speech Emotion Prediction', Multimedia Tools and Applications, vol. 74, no. 22, pp. 9983-10000. https://doi.org/10.1007/s11042-014-2319-1
Wang, F., Sahli, H., Gao, J., Jiang, D., & Verhelst, W. (2015). Relevance Units Machine based Dimensional and Continuous Speech Emotion Prediction. Multimedia Tools and Applications, 74(22), 9983-10000. https://doi.org/10.1007/s11042-014-2319-1
@article{72cdf86bdc904e578ead306c7bd68dbd,
title = "Relevance Units Machine based Dimensional and Continuous Speech Emotion Prediction",
abstract = "Emotion plays a significant role in human-computer interaction. The continuing improvements in speech technology have let to many new and fascinating applications in human-computer interaction, context aware computing and computer mediated communication. Such applications require reliable online recognition of the user's affect. However most emotion recognition systems are based son speech via an isolated short sentence or word. We present a framework for online emotion recognition from speech. On the front-end, a voice activity detection algorithm is used to segment the input speech, and feature are estimated to model long-term properties. Then, dimensional and continuous emotion recognition is performed via a Relevance Units Machine (RUM). The advantages of the proposed systems are: (i) its computational efficiency in run-time (regression outputs can be produced continuously in pseudo real-time), (ii) RUM offers superior sparsity to the well-known Support Vector Regression (SVR) and Relevance Vector Machine for regression (RVR), and (iii) RUM's predictive performance is comparable to SVR and RVR.",
keywords = "Relevance units machine, Continuous speech emotion regression, Dimensional emotion modeling",
author = "Fengna Wang and Hichem Sahli and Junbin Gao and Dongmei Jiang and Werner Verhelst",
year = "2015",
month = oct,
day = "26",
doi = "10.1007/s11042-014-2319-1",
language = "English",
volume = "74",
pages = "9983--10000",
journal = "Multimedia Tools and Applications",
issn = "1380-7501",
publisher = "Springer Netherlands",
number = "22",
}