Evaluating interactive systems from an emotional perspective

Palabras clave

user experience

Cómo citar

Méndez Alegria, Y. A., Collazos Ordóñez, C. A., Granollers Saltiveri, A., & Huitr, A. S. (2014). Evaluating interactive systems from an emotional perspective. Revista Guillermo De Ockham, 12(1), 43–50. https://doi.org/10.21500/22563202.42


In this paper, we introduce a model that aims to provide guidelines that will strengthen the evaluation of interactive systems by assisting in the identification and analysis of emotions evoked by users during system usage. We briefly discuss related projects that have included emotions in the evaluation of interactive systems. The research presented here is a preliminary work towards the inclusion of emotions during the evaluation of interactive systems. Our model is presented including details of each of its phases. We discussed preliminary results of the application of the model to evaluating a Virtual Learning Environment. Our approach comprises four major phases: Selection of relevant emotions; analysis of relationships between emotions and interactive systems; selection of detection mechanisms; and application of evaluation methods.



Agarwal, A., & Meyer, A. (2009). Beyond usability: evaluating emotional response as an integral part of the user experience. In CHI 09 Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (pp. 2919–2930). ACM. doi:10.1145/1520340.1520420

Bak, J., Nguyen, K., Risgaard, P., & Stage, J. (2008). Obstacles to usability evaluation in practice: A survey of software development organizations. Proceedings of the 5th Nordic Conference on Human-Computer Interaction: Building Bridges. Retrieved from http://doi.acm.org/10.1145/1463160.1463164

Branco, P., Firth, P., Encarnação, L. M., & Bonato, P. (2005). Faces of emotion in human-computer interaction. Work, 1236–1239. doi:10.1145/1056808.1056885

Brave, S., & Nass, C. (2008). Emotion in Human-Computer Interaction. In A. Sears & J. A. Jacko (Eds.), The Human-Computer Interaction Handbook. Fundamentals, Evolving Technologies and Emerging Applications. (Second., Vol. 29, p. 1386). Standford University: Lawrence Erlbaum Associates. Retrieved from http://courses.washington.edu/imt540a/readings/Blomberg-08.pdf

Champney, R. K., & Stanney, K. M. (2007). Using Emotions in Usability. Proceedings of the Human Factors and Ergonomics Society, 2, 1044–1049. Retrieved from http://www.ingentaconnect.com/content/hfes/hfproc/2007/00000051/00000017/art00012

Cortés-Silva, X. (2013). Vikara: Plataforma de desarrollo y gestión de aplicaciones para detección de emociones. Department of computing, electronics and mechatronics. Tesis no publicada. Universidad de las Américas Puebla.

Cowan, B. R., Vigentini, L., & Jack, M. A. (2009). Exploring the effects of experience on wiki anxiety and wiki usability: an online study. Proceedings of the 23rd British HCI Group Annual Conference on People and Computers Celebrating People and Technology, 175–183. Retrieved from http://portal.acm.org/citation.cfm?id=1671032

D’mello, S., & Calvo, R. A. (2013). Beyond the Basic Emotions: What Should Affective Computing Compute? In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (pp. 2287–2294). New York, NY, USA: ACM. doi:10.1145/2468356.2468751

Damasio, A. R. (2003). Looking for Spinoza: Joy, Sorrow, and the Feeling Brain. Orlando Harcourt (Vol. 1st, p. 355). Harcourt. Retrieved from http://www.loc.gov/catdir/description/har021/2002011347.html

Desmet, P. (2004). Measuring emotion: development and application of an instrument to measure emotional responses to products. In M. A. Blythe, K. Overbeeke, A. F. Monk, & P. C. Wright (Eds.), Funology (Vol. 41, pp. 111–123). Kluwer Academic Publishers. doi:10.1007/1-4020-2967-5

Desmet, P., Overbeeke, K., & Tax, S. (2001). Designing Products with Added Emotional Value: Development and Appllcation of an Approach for Research Through Design. The Design Journal, 4(1), 32–47. doi:10.2752/146069201789378496

Frøkjær, E., & Hornbæk, K. (2008). Metaphors of human thinking for usability inspection and design. ACM Transactions on Computer-Human Interaction, 14(4), 1–33. doi:10.1145/1314683.1314688

Lera, E. De, & Garreta-Domingo, M. (2007). Ten Emotion Heuristics : Guidelines for assessing the user ’ s affective dimension easily and cost-effectively. Group, 2(September), 7–10. Retrieved from http://portal.acm.org/citation.cfm?id=1531450

Méndez, Y. A., Collazos, C. A., Granollers, T., & Sánchez, J. A. (2013). Emo+Eval: Including Emotions in the Process of Evaluating Interactive Systems. In Proceedings of the 2013 Chilean Conference on Human - Computer Interaction (pp. 48–49). New York, NY, USA: ACM. doi:10.1145/2535597.2535612

Norman, D. A. (2004). Emotional Design: Why We Love (or Hate) Everyday Things. The Journal of American Culture (Vol. 2006, p. 272). Basic Books. doi:10.1111/j.1537-4726.2004.133_10.x

Peter, C., Beale, R., Crane, E., & Axelrod, L. (2007). Emotion in HCI. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 2 (pp. 211–212). Swinton, UK, UK: British Computer Society. Retrieved from http://dl.acm.org/citation.cfm?id=1531407.1531471

Petrie, H. (2010). Measuring User Experience of websites : Think aloud protocols and an emotion word prompt list. Methods, 3673–3678. doi:10.1145/1753846.1754037

Petrie, H., & Harrison, C. (2009). Measuring users' emotional reactions to websites. Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (pp. 3847-3852). Boston, MA, USA: ACM. doi: http://doi.acm.org/10.1145/1520340.1520582

Picard, R. (2000). Affective Perception. Communications of the ACM,, 43, 50–51. Retrieved from http://affect.media.mit.edu/pdfs/00.picard-cacm.pdf

Picard, R., & Daily, S. (2005). Evaluating affective interactions: Alternatives to asking what users feel. CHI Workshop on Evaluating Affective …. Retrieved from http://mit.sustech.edu/NR/rdonlyres/Media-Arts-and-Sciences/MAS-630Spring-2008/Readings/picard_chi2005.pdf

Reeve, J. (1996). Motivacion y Emoción (McGraw-Hil.). University of Rochester, River Campus.

Reeve, J. (2010). Motivacion y Emoción (5ª Edi.). México: McGraw Hill.

Saroha, K., Sharma, S., & Bhatia, G. (2011). Human Computer Interaction: An intellectual approach. IJCSMS International Journal of Computer Science and Management Studies, 11(02), 147–154. Retrieved from http://www.ijcsms.com/journals/Volume 11, Issue 02, Aug 2011_Paper25.pdf

Thompson, E. R. (2007). Development and Validation of an Internationally Reliable Short-Form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227–242. doi:10.1177/0022022106297301

Tsai, T. C., Chen, J. J., & Lo, W. C. (2009). Design and Implementation of Mobile Personal Emotion Monitoring System. In Proceedings of the 2009 Tenth International Conference on Mobile Data Management: Systems, Services and Middleware (pp. 430–435). Washington, DC, USA: IEEE Computer Society. doi:10.1109/MDM.2009.78

Watson, D., Clark, L. A., & Tellegen, A. (1988). Development of brief measures of positive and negative affect: The PANAS scale. The PANAS Scales Journal of Personality and Social Psychology, 47, 1063–1070.

Zaman, B., & Shrimpton-Smith, T. (2006). The FaceReader: Measuring instant fun of use. In A. Mørch, K. Morgan, T. Bratteteig, G. Ghosh, & D. Svanaes (Eds.), NordiCHI (Vol. 189, pp. 457–460). ACM Press. doi:10.1145/1182475.1182536

La Revista Guillermo de Ockham brinda un acceso inmediato y abierto a su contenido, basado en el principio de ofrecer al público un acceso gratuito a las investigaciones para brindar un intercambio global de conocimiento.
A menos que se establezca lo contrario, el contenido de esta revista tiene una licencia con Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) http://creativecommons.org/licenses/by-nc-nd/4.0/

  • Atribución: debe otorgar el crédito correspondiente, proporcionar un enlace a la licencia e indicar si se realizaron cambios. Puede hacerlo de cualquier manera razonable, pero no de ninguna manera que sugiera que el licenciante lo respalda a usted o su uso.
  • No comercial: no puede utilizar el material con fines comerciales.
  • Sin derivados: si remezcla, transforma o construye sobre el material, no puede distribuir el material modificado.
  • Sin restricciones adicionales: no puede aplicar términos legales o medidas tecnológicas que restrinjan legalmente a otros de hacer cualquier cosa que permita la licencia.


Los datos de descargas todavía no están disponibles.