University of Leicester
8751426.pdf (2.5 MB)

Multimodal Affective Computing to Enhance the User Experience of Educational Software Applications

Download (2.5 MB)
journal contribution
posted on 2019-06-14, 11:25 authored by J Maria Garcia-Garcia, VMR Penichet, M Dolores Lozano, J Enrique Garrido, EL-C Law
Affective computing is becoming more and more important as it enables to extend the possibilities of computing technologies by incorporating emotions. In fact, the detection of users’ emotions has become one of the most important aspects regarding Affective Computing. In this paper, we present an educational software application that incorporates affective computing by detecting the users’ emotional states to adapt its behaviour to the emotions sensed. This way, we aim at increasing users’ engagement to keep them motivated for longer periods of time, thus improving their learning progress. To prove this, the application has been assessed with real users. The performance of a set of users using the proposed system has been compared with a control group that used the same system without implementing emotion detection. The outcomes of this evaluation have shown that our proposed system, incorporating affective computing, produced better results than the one used by the control group.


This research work has been partially funded by the regional project of JCCM with reference SBPLY/17/180501/000495, by the Scholarship Program granted by the Spanish Ministry of Education, Culture and Sport, and the predoctoral fellowship with reference 2017-BCL-6528, granted by the University of Castilla-La Mancha. We would also like to thank the teachers and pupils from the primary school “Escolapios” who collaborated in the assessment of the system.



Mobile Information Systems, 2018, 8751426

Author affiliation

/Organisation/COLLEGE OF SCIENCE AND ENGINEERING/Department of Informatics


  • VoR (Version of Record)

Published in

Mobile Information Systems


Hindawi, IOS Press





Acceptance date


Copyright date


Available date


Publisher version


The data used to support the findings of this study are available from the corresponding author upon request.