TELKOMNIKA Telecommunication, Computing, Electronics and Control
Identifier of human emotions based on convolutional neural network for assistant robot

TELKOMNIKA Telecommunication, Computing, Electronics and Control
Identifier of human emotions based on convolutional neural network for assistant robot

Autonomous robot, Convolutional neuronal network, Human emotions, Service robot

This paper proposes a solution for the problem of continuous prediction in real-time of the emotional state of a human user from the identification of characteristics in facial expressions. In robots whose main task is the care of people (children, sick or elderly people) is important to maintain a close relationship man-machine, anld a rapid response of the robot to the actions of the person under care. We propose to increase the level of intimacy of the robot, and its response to specific situations of the user, identifying in real time the emotion reflected by the person's face. This solution is integrated with algorithms of the research group related to the tracking of people for use on an assistant robot. The strategy used involves two stages of processing, the first involves the detection of faces using HOG and linear SVM, while the second identifies the emotion in the face using a CNN. The strategy was completely tested in the laboratory on our robotic platform, demonstrating high performance with low resource consumption. Through various controlled laboratory tests with different people, which forced a certain emotion on their faces, the scheme was able to identify the emotions with a success rate of 92%.

Fredy Martínez, César Hernández, Angélica Rendón

DOI: 10.12928/TELKOMNIKA.v18i3.14777

Universitas Ahmad Dahlan

June 2020

Sri Wahyuni

ISSN: 1693-6930

http://journal.uad.ac.id/index.php/TELKOMNIKA

PDF

English

Text

TELKOMNIKA Telecommunication, Computing, Electronics and Control