Emotion Recognition from Human Behaviors Using Attention Model

James Jie Deng, Clement Ho Cheung Leung, Paolo Mengoni, Yuanxi Li

Research output: Chapter in book/report/conference proceedingConference contributionpeer-review

8 Citations (Scopus)

Abstract

Human behaviors and the emotional states that they convey have been studied by psychologist and sociologists. The tracking of behaviors and emotions is becoming more pervasive with the advent of the Internet of Things (IoT), where small and always connected sensors can continuously capture information about human gestures, movements and postures. The captured information about readable behaviors conveys signicant information that can be represented as time series. Few studies in emotion recognition and affective computing have explored the connection between the time series sensors data and the emotional behavior they conveys. In this paper, an innovative approach is proposed to study the emotions and behaviors connected to the sensors time series data. A deep learning attention-based bidirectional LSTM is introduced to represent the correlations between data and emotions. The attention-based mechanism is then used to focus on the most significant information. The advantage of this model is that it can represent various human emotions by exploiting the data captured by sensors. The experimental results show that the proposed deep learning method outperforms shallow models and achieves a high degree of accuracy for modelling human behaviors and emotions.

Original languageEnglish
Title of host publicationProceedings - 2018 1st IEEE International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2018
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages249-253
Number of pages5
ISBN (Electronic)9781538695555
ISBN (Print)9781538695562
DOIs
Publication statusPublished - Sep 2018
Event1st IEEE International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2018 - Laguna Hills, United States
Duration: 26 Sep 201828 Sep 2018

Publication series

NameProceedings - IEEE International Conference on Artificial Intelligence and Knowledge Engineering

Conference

Conference1st IEEE International Conference on Artificial Intelligence and Knowledge Engineering, AIKE 2018
Country/TerritoryUnited States
CityLaguna Hills
Period26/09/1828/09/18

Scopus Subject Areas

  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Science Applications

User-Defined Keywords

  • Attention model
  • Bi-LSTM
  • Deep learning
  • Emotion recognition
  • LSTM

Fingerprint

Dive into the research topics of 'Emotion Recognition from Human Behaviors Using Attention Model'. Together they form a unique fingerprint.

Cite this