Selma Yilmazyildiz, David Henderickx, Bram Vanderborght, Werner Verhelst, Eric Soetens, Dirk Lefeber
Gibberish speech consists of vocalizations of meaningless strings of speech sounds. It is sometimes used by performing artists or by cartoon animations (e.g.: Teletubbies) to express intended emotions, without pronouncing any actually understandable word. The facts that no understandable text has to be pronounced and that only affect is conveyed create the advantage of gibberish in affective computing. In our study, we intend to experiment the communication between a robot and hospitalized children using affective gibberish. In this study, a new emotional database consisting of 4 distinct corpuses has been recorded for the purpose of affective child-robot interaction. The database comprises speech recordings of one actress simulating a neutral state and the big six emotions: anger, disgust, fear, happiness, sadness and surprise. The database has been evaluated through a perceptual test for all subsets of the database by adults and one subset of the database with children, achieving recognition scores up to 81%.
Yilmazyildiz, S, Henderickx, D, Vanderborght, B, Verhelst, W, Soetens, E & Lefeber, D 2011, EMOGIB: Emotional Gibberish Speech Database for Affective Human-Robot Interaction. in S DMello, A Graesser & B Schuller (eds), Affective computing and Intelligent interaction PTII. vol. 6975, Lecture Notes in Computer Science, Springer Berlin, Memphis, pp. 163-172, Affective Computing and Intelligent Interaction, Memphis, United States, 9/10/11. <http://www.etro.vub.ac.be/Research/DSSP/PUB_FILES/int_conf/ACII2011_yilmazyildiz.pdf>
Yilmazyildiz, S., Henderickx, D., Vanderborght, B., Verhelst, W., Soetens, E., & Lefeber, D. (2011). EMOGIB: Emotional Gibberish Speech Database for Affective Human-Robot Interaction. In S. DMello, A. Graesser, & B. Schuller (Eds.), Affective computing and Intelligent interaction PTII (Vol. 6975, pp. 163-172). (Lecture Notes in Computer Science). Springer Berlin. http://www.etro.vub.ac.be/Research/DSSP/PUB_FILES/int_conf/ACII2011_yilmazyildiz.pdf
@inproceedings{f53b2c0aaf8f4e4d83e01e646ce579b2,
title = "EMOGIB: Emotional Gibberish Speech Database for Affective Human-Robot Interaction",
abstract = "Gibberish speech consists of vocalizations of meaningless strings of speech sounds. It is sometimes used by performing artists or by cartoon animations (e.g.: Teletubbies) to express intended emotions, without pronouncing any actually understandable word. The facts that no understandable text has to be pronounced and that only affect is conveyed create the advantage of gibberish in affective computing. In our study, we intend to experiment the communication between a robot and hospitalized children using affective gibberish. In this study, a new emotional database consisting of 4 distinct corpuses has been recorded for the purpose of affective child-robot interaction. The database comprises speech recordings of one actress simulating a neutral state and the big six emotions: anger, disgust, fear, happiness, sadness and surprise. The database has been evaluated through a perceptual test for all subsets of the database by adults and one subset of the database with children, achieving recognition scores up to 81%.",
keywords = "emotional speech database, emotional speech corpus, affective speech synthesis, gibberish speech synthesis, emotional speech synthesis, human-computer interaction",
author = "Selma Yilmazyildiz and David Henderickx and Bram Vanderborght and Werner Verhelst and Eric Soetens and Dirk Lefeber",
note = "Sidney D'Mello, Arthur Graesser, Bj{\"o}rn Schuller, Jean-Claude Martin; Affective Computing and Intelligent Interaction ; Conference date: 09-10-2011 Through 12-10-2011",
year = "2011",
language = "English",
volume = "6975",
series = "Lecture Notes in Computer Science",
publisher = "Springer Berlin",
pages = "163--172",
editor = "S DMello and A Graesser and B Schuller",
booktitle = "Affective computing and Intelligent interaction PTII",
address = "Germany",
url = "http://www.acii2011.org/",
}