EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Speech Emotion Recognition Using Convolutional Neural Networks with Attention Mechanism

Konstantinos Mountzouris, Isidoros Perikos, Ioannis Hatzilygeroudis

Electronics · 23.10.2023 · 12 (20) · 4376

DOI: 10.3390/electronics12204376 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 23.10.2023. Verfasst von Konstantinos Mountzouris und 2 weiteren Autor:innen. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Speech emotion recognition (SER) is an interesting and difficult problem to handle. In this paper, we deal with it through the implementation of deep learning networks. We have designed and implemented six different deep learning networks, a deep belief network (DBN), a simple deep neural network (SDNN), an LSTM network (LSTM), an LSTM network with the addition of an attention mechanism (LSTM-ATN), a convolutional neural network (CNN), and a convolutional neural network with the addition of an attention mechanism (CNN-ATN), having in mind, apart from solving the SER problem, to test the impact of the attention mechanism on the results. Dropout and batch normalization techniques are also used to improve the generalization ability (prevention of overfitting) of the models as well as to speed up the training process. The Surrey Audio–Visual Expressed Emotion (SAVEE) database and the Ryerson Audio–Visual Database (RAVDESS) were used for the training and evaluation of our models. The results showed that the networks with the addition of the attention mechanism did better than the others. Furthermore, they showed that the CNN-ATN was the best among the tested networks, achieving an accuracy of 74% for the SAVEE database and 77% for the RAVDESS, and exceeding existing state-of-the-art systems for the same datasets.

Zitieren

APA

Mountzouris, K., Perikos, I., & Hatzilygeroudis, I. (2023). Speech Emotion Recognition Using Convolutional Neural Networks with Attention Mechanism. Electronics, 12(20), 4376. https://doi.org/10.3390/electronics12204376

Vancouver

Mountzouris K, Perikos I, Hatzilygeroudis I. Speech Emotion Recognition Using Convolutional Neural Networks with Attention Mechanism. Electronics. 2023;12(20):4376. doi:10.3390/electronics12204376

BibTeX
@article{Mountzouris2023,
  author = {Mountzouris, Konstantinos and Perikos, Isidoros and Hatzilygeroudis, Ioannis},
  title = {Speech Emotion Recognition Using Convolutional Neural Networks with Attention Mechanism},
  journal = {Electronics},
  year = {2023},
  volume = {12},
  number = {20},
  pages = {4376},
  doi = {10.3390/electronics12204376}
}
Kostenlos starten →