View/Download
PDF (Español (España))
FLIP
How to Cite
Méndez Alegria, Y. A., Collazos Ordóñez, C. A., Granollers Saltiveri, A., & Huitr, A. S. (2014). Evaluating interactive systems from an emotional perspective. Revista Guillermo De Ockham, 12(1), 43–50. https://doi.org/10.21500/22563202.42
More Citation Formats
License terms
▼
The Revista Guillermo de Ockham provides an immediate and open access to its content, based on the principle of offering the public a free access to investigations to provide a global interchange of knowledge.
Unless otherwise established, the contents of this journal has a license with Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) http://creativecommons.org/licenses/by-nc-nd/4.0/
- Attribution: You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
- NonCommercial: You may not use the material for commercial purposes.
- NoDerivatives: If you remix, transform, or build upon the material, you may not distribute the modified material.
- No additional restrictions: You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Abstract
In this paper, we introduce a model that aims to provide guidelines that will strengthen the evaluation of interactive systems by assisting in the identification and analysis of emotions evoked by users during system usage. We briefly discuss related projects that have included emotions in the evaluation of interactive systems. The research presented here is a preliminary work towards the inclusion of emotions during the evaluation of interactive systems. Our model is presented including details of each of its phases. We discussed preliminary results of the application of the model to evaluating a Virtual Learning Environment. Our approach comprises four major phases: Selection of relevant emotions; analysis of relationships between emotions and interactive systems; selection of detection mechanisms; and application of evaluation methods.
References
Agarwal, A., & Meyer, A. (2009). Beyond usability: evaluating emotional response as an integral part of the user experience. In CHI 09 Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (pp. 2919–2930). ACM. doi:10.1145/1520340.1520420
Bak, J., Nguyen, K., Risgaard, P., & Stage, J. (2008). Obstacles to usability evaluation in practice: A survey of software development organizations. Proceedings of the 5th Nordic Conference on Human-Computer Interaction: Building Bridges. Retrieved from http://doi.acm.org/10.1145/1463160.1463164
Branco, P., Firth, P., Encarnação, L. M., & Bonato, P. (2005). Faces of emotion in human-computer interaction. Work, 1236–1239. doi:10.1145/1056808.1056885
Brave, S., & Nass, C. (2008). Emotion in Human-Computer Interaction. In A. Sears & J. A. Jacko (Eds.), The Human-Computer Interaction Handbook. Fundamentals, Evolving Technologies and Emerging Applications. (Second., Vol. 29, p. 1386). Standford University: Lawrence Erlbaum Associates. Retrieved from http://courses.washington.edu/imt540a/readings/Blomberg-08.pdf
Champney, R. K., & Stanney, K. M. (2007). Using Emotions in Usability. Proceedings of the Human Factors and Ergonomics Society, 2, 1044–1049. Retrieved from http://www.ingentaconnect.com/content/hfes/hfproc/2007/00000051/00000017/art00012
Cortés-Silva, X. (2013). Vikara: Plataforma de desarrollo y gestión de aplicaciones para detección de emociones. Department of computing, electronics and mechatronics. Tesis no publicada. Universidad de las Américas Puebla.
Cowan, B. R., Vigentini, L., & Jack, M. A. (2009). Exploring the effects of experience on wiki anxiety and wiki usability: an online study. Proceedings of the 23rd British HCI Group Annual Conference on People and Computers Celebrating People and Technology, 175–183. Retrieved from http://portal.acm.org/citation.cfm?id=1671032
D’mello, S., & Calvo, R. A. (2013). Beyond the Basic Emotions: What Should Affective Computing Compute? In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (pp. 2287–2294). New York, NY, USA: ACM. doi:10.1145/2468356.2468751
Damasio, A. R. (2003). Looking for Spinoza: Joy, Sorrow, and the Feeling Brain. Orlando Harcourt (Vol. 1st, p. 355). Harcourt. Retrieved from http://www.loc.gov/catdir/description/har021/2002011347.html
Desmet, P. (2004). Measuring emotion: development and application of an instrument to measure emotional responses to products. In M. A. Blythe, K. Overbeeke, A. F. Monk, & P. C. Wright (Eds.), Funology (Vol. 41, pp. 111–123). Kluwer Academic Publishers. doi:10.1007/1-4020-2967-5
Desmet, P., Overbeeke, K., & Tax, S. (2001). Designing Products with Added Emotional Value: Development and Appllcation of an Approach for Research Through Design. The Design Journal, 4(1), 32–47. doi:10.2752/146069201789378496
Frøkjær, E., & Hornbæk, K. (2008). Metaphors of human thinking for usability inspection and design. ACM Transactions on Computer-Human Interaction, 14(4), 1–33. doi:10.1145/1314683.1314688
Lera, E. De, & Garreta-Domingo, M. (2007). Ten Emotion Heuristics : Guidelines for assessing the user ’ s affective dimension easily and cost-effectively. Group, 2(September), 7–10. Retrieved from http://portal.acm.org/citation.cfm?id=1531450
Méndez, Y. A., Collazos, C. A., Granollers, T., & Sánchez, J. A. (2013). Emo+Eval: Including Emotions in the Process of Evaluating Interactive Systems. In Proceedings of the 2013 Chilean Conference on Human - Computer Interaction (pp. 48–49). New York, NY, USA: ACM. doi:10.1145/2535597.2535612
Norman, D. A. (2004). Emotional Design: Why We Love (or Hate) Everyday Things. The Journal of American Culture (Vol. 2006, p. 272). Basic Books. doi:10.1111/j.1537-4726.2004.133_10.x
Peter, C., Beale, R., Crane, E., & Axelrod, L. (2007). Emotion in HCI. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 2 (pp. 211–212). Swinton, UK, UK: British Computer Society. Retrieved from http://dl.acm.org/citation.cfm?id=1531407.1531471
Petrie, H. (2010). Measuring User Experience of websites : Think aloud protocols and an emotion word prompt list. Methods, 3673–3678. doi:10.1145/1753846.1754037
Petrie, H., & Harrison, C. (2009). Measuring users' emotional reactions to websites. Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (pp. 3847-3852). Boston, MA, USA: ACM. doi: http://doi.acm.org/10.1145/1520340.1520582
Picard, R. (2000). Affective Perception. Communications of the ACM,, 43, 50–51. Retrieved from http://affect.media.mit.edu/pdfs/00.picard-cacm.pdf
Picard, R., & Daily, S. (2005). Evaluating affective interactions: Alternatives to asking what users feel. CHI Workshop on Evaluating Affective …. Retrieved from http://mit.sustech.edu/NR/rdonlyres/Media-Arts-and-Sciences/MAS-630Spring-2008/Readings/picard_chi2005.pdf
Reeve, J. (1996). Motivacion y Emoción (McGraw-Hil.). University of Rochester, River Campus.
Reeve, J. (2010). Motivacion y Emoción (5ª Edi.). México: McGraw Hill.
Saroha, K., Sharma, S., & Bhatia, G. (2011). Human Computer Interaction: An intellectual approach. IJCSMS International Journal of Computer Science and Management Studies, 11(02), 147–154. Retrieved from http://www.ijcsms.com/journals/Volume 11, Issue 02, Aug 2011_Paper25.pdf
Thompson, E. R. (2007). Development and Validation of an Internationally Reliable Short-Form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227–242. doi:10.1177/0022022106297301
Tsai, T. C., Chen, J. J., & Lo, W. C. (2009). Design and Implementation of Mobile Personal Emotion Monitoring System. In Proceedings of the 2009 Tenth International Conference on Mobile Data Management: Systems, Services and Middleware (pp. 430–435). Washington, DC, USA: IEEE Computer Society. doi:10.1109/MDM.2009.78
Watson, D., Clark, L. A., & Tellegen, A. (1988). Development of brief measures of positive and negative affect: The PANAS scale. The PANAS Scales Journal of Personality and Social Psychology, 47, 1063–1070.
Zaman, B., & Shrimpton-Smith, T. (2006). The FaceReader: Measuring instant fun of use. In A. Mørch, K. Morgan, T. Bratteteig, G. Ghosh, & D. Svanaes (Eds.), NordiCHI (Vol. 189, pp. 457–460). ACM Press. doi:10.1145/1182475.1182536
Bak, J., Nguyen, K., Risgaard, P., & Stage, J. (2008). Obstacles to usability evaluation in practice: A survey of software development organizations. Proceedings of the 5th Nordic Conference on Human-Computer Interaction: Building Bridges. Retrieved from http://doi.acm.org/10.1145/1463160.1463164
Branco, P., Firth, P., Encarnação, L. M., & Bonato, P. (2005). Faces of emotion in human-computer interaction. Work, 1236–1239. doi:10.1145/1056808.1056885
Brave, S., & Nass, C. (2008). Emotion in Human-Computer Interaction. In A. Sears & J. A. Jacko (Eds.), The Human-Computer Interaction Handbook. Fundamentals, Evolving Technologies and Emerging Applications. (Second., Vol. 29, p. 1386). Standford University: Lawrence Erlbaum Associates. Retrieved from http://courses.washington.edu/imt540a/readings/Blomberg-08.pdf
Champney, R. K., & Stanney, K. M. (2007). Using Emotions in Usability. Proceedings of the Human Factors and Ergonomics Society, 2, 1044–1049. Retrieved from http://www.ingentaconnect.com/content/hfes/hfproc/2007/00000051/00000017/art00012
Cortés-Silva, X. (2013). Vikara: Plataforma de desarrollo y gestión de aplicaciones para detección de emociones. Department of computing, electronics and mechatronics. Tesis no publicada. Universidad de las Américas Puebla.
Cowan, B. R., Vigentini, L., & Jack, M. A. (2009). Exploring the effects of experience on wiki anxiety and wiki usability: an online study. Proceedings of the 23rd British HCI Group Annual Conference on People and Computers Celebrating People and Technology, 175–183. Retrieved from http://portal.acm.org/citation.cfm?id=1671032
D’mello, S., & Calvo, R. A. (2013). Beyond the Basic Emotions: What Should Affective Computing Compute? In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (pp. 2287–2294). New York, NY, USA: ACM. doi:10.1145/2468356.2468751
Damasio, A. R. (2003). Looking for Spinoza: Joy, Sorrow, and the Feeling Brain. Orlando Harcourt (Vol. 1st, p. 355). Harcourt. Retrieved from http://www.loc.gov/catdir/description/har021/2002011347.html
Desmet, P. (2004). Measuring emotion: development and application of an instrument to measure emotional responses to products. In M. A. Blythe, K. Overbeeke, A. F. Monk, & P. C. Wright (Eds.), Funology (Vol. 41, pp. 111–123). Kluwer Academic Publishers. doi:10.1007/1-4020-2967-5
Desmet, P., Overbeeke, K., & Tax, S. (2001). Designing Products with Added Emotional Value: Development and Appllcation of an Approach for Research Through Design. The Design Journal, 4(1), 32–47. doi:10.2752/146069201789378496
Frøkjær, E., & Hornbæk, K. (2008). Metaphors of human thinking for usability inspection and design. ACM Transactions on Computer-Human Interaction, 14(4), 1–33. doi:10.1145/1314683.1314688
Lera, E. De, & Garreta-Domingo, M. (2007). Ten Emotion Heuristics : Guidelines for assessing the user ’ s affective dimension easily and cost-effectively. Group, 2(September), 7–10. Retrieved from http://portal.acm.org/citation.cfm?id=1531450
Méndez, Y. A., Collazos, C. A., Granollers, T., & Sánchez, J. A. (2013). Emo+Eval: Including Emotions in the Process of Evaluating Interactive Systems. In Proceedings of the 2013 Chilean Conference on Human - Computer Interaction (pp. 48–49). New York, NY, USA: ACM. doi:10.1145/2535597.2535612
Norman, D. A. (2004). Emotional Design: Why We Love (or Hate) Everyday Things. The Journal of American Culture (Vol. 2006, p. 272). Basic Books. doi:10.1111/j.1537-4726.2004.133_10.x
Peter, C., Beale, R., Crane, E., & Axelrod, L. (2007). Emotion in HCI. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 2 (pp. 211–212). Swinton, UK, UK: British Computer Society. Retrieved from http://dl.acm.org/citation.cfm?id=1531407.1531471
Petrie, H. (2010). Measuring User Experience of websites : Think aloud protocols and an emotion word prompt list. Methods, 3673–3678. doi:10.1145/1753846.1754037
Petrie, H., & Harrison, C. (2009). Measuring users' emotional reactions to websites. Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (pp. 3847-3852). Boston, MA, USA: ACM. doi: http://doi.acm.org/10.1145/1520340.1520582
Picard, R. (2000). Affective Perception. Communications of the ACM,, 43, 50–51. Retrieved from http://affect.media.mit.edu/pdfs/00.picard-cacm.pdf
Picard, R., & Daily, S. (2005). Evaluating affective interactions: Alternatives to asking what users feel. CHI Workshop on Evaluating Affective …. Retrieved from http://mit.sustech.edu/NR/rdonlyres/Media-Arts-and-Sciences/MAS-630Spring-2008/Readings/picard_chi2005.pdf
Reeve, J. (1996). Motivacion y Emoción (McGraw-Hil.). University of Rochester, River Campus.
Reeve, J. (2010). Motivacion y Emoción (5ª Edi.). México: McGraw Hill.
Saroha, K., Sharma, S., & Bhatia, G. (2011). Human Computer Interaction: An intellectual approach. IJCSMS International Journal of Computer Science and Management Studies, 11(02), 147–154. Retrieved from http://www.ijcsms.com/journals/Volume 11, Issue 02, Aug 2011_Paper25.pdf
Thompson, E. R. (2007). Development and Validation of an Internationally Reliable Short-Form of the Positive and Negative Affect Schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), 227–242. doi:10.1177/0022022106297301
Tsai, T. C., Chen, J. J., & Lo, W. C. (2009). Design and Implementation of Mobile Personal Emotion Monitoring System. In Proceedings of the 2009 Tenth International Conference on Mobile Data Management: Systems, Services and Middleware (pp. 430–435). Washington, DC, USA: IEEE Computer Society. doi:10.1109/MDM.2009.78
Watson, D., Clark, L. A., & Tellegen, A. (1988). Development of brief measures of positive and negative affect: The PANAS scale. The PANAS Scales Journal of Personality and Social Psychology, 47, 1063–1070.
Zaman, B., & Shrimpton-Smith, T. (2006). The FaceReader: Measuring instant fun of use. In A. Mørch, K. Morgan, T. Bratteteig, G. Ghosh, & D. Svanaes (Eds.), NordiCHI (Vol. 189, pp. 457–460). ACM Press. doi:10.1145/1182475.1182536
Downloads
Download data is not yet available.
Cited by
