Power, Control, and Data Processing Systems

Power, Control, and Data Processing Systems

A New Method for Detecting Emotions in Video Using a Hybrid CNN-RNN-RBM Network

Document Type : Original Research

Authors
1 Electrical and Computer Engineering Department, Hamedan University of Technology, Hamedan, Iran
2 M.Sc. Student, Electrical and Computer Engineering Department, Hamedan University of Technology, Hamedan, Iran
10.30511/pcdp.2026.2087714.1069
Abstract
Facial expressions are one of the most important techniques of non-verbal communication that humans use to display their emotional states and establish non-verbal communication. In recent research in the field of emotion recognition based on facial expression changes, deep learning networks are used. In this regard, an appropriate network is selected according to the type of data. In the present research, video data is used, and for recognizing facial expressions, recurrent networks are employed. Subsequently, to achieve better results, a hybrid network consisting of Convolutional, Recurrent, and Restricted Boltzmann Machine networks has also been used. Finally, in this paper, using deep learning techniques and the Python language, an algorithm based on a hybrid CNN-LSTM-RBM neural network for emotion recognition through facial expressions in a video is presented. In this method, seven emotional states (happy, sad, disgust, excitement, contempt, fear, and anger) are detected. The CK+48 dataset has been used to train and test the proposed model. The experimental results demonstrate that the proposed Hybrid CNN-LSTM-GRBM model achieves a training accuracy of 99.06%. Crucially, the model attains 91.16% test accuracy and an F1-score of 89.27% on the test set, outperforming existing baseline methods and confirming its robustness in handling spatiotemporal facial features.
Keywords
Subjects


Articles in Press, Accepted Manuscript
Available Online from 01 July 2026

  • Receive Date 29 April 2026
  • Revise Date 29 June 2026
  • Accept Date 01 July 2026
  • First Publish Date 01 July 2026
  • Publish Date 01 July 2026