A review of visualization assessment in terms of user performance and experience

Ana Figueiras

doi:10.1109/iV.2018.00035

A review of visualization assessment in terms of user performance and experience

Ana Figueiras

Centro de Investigação em Comunicação, Informação e Cultura Digital (CIC. Digital)

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

4 Citations (Scopus)

Abstract

Traditionally, information visualization research tends to focus only on performance related metrics such as task completion time and correctness. However, a recent interest on goals such as memorability, engagement, and fun has also sparked. We propose a reflection on visualization assessment supported by a profound analysis of research that includes user studies of visualization tools and techniques. The motivation for this study is to explore the possible benefits of having a unified standardized metric for usability and user experience that can become a clearer quantitative model of both. Such a metric can provide visualization researchers and practitioners a more succinct and accurate way to assess their visualizations.

Original language	English
Title of host publication	Information Visualisation - Biomedical Visualization, Visualisation on Built and Rural Environments and Geometric Modelling and Imaging, IV 2018
Editors	Joao Moura Pires, Nuno Miguel Soares Datia, Giuseppe Polese, Marco Temperini, Filippo Sciarrone, Michele Risi, Gilles Venturini, Tania Di Mascio, Rocco Zaccagnino, Vincenzo Deufemia, Delfina Malandrino, Paloma Diaz, Antonio Fernandez Anta, Ebad Banissi, Theodor G. Wyeld, Muhammad Sarfraz, Fatma Bouali, Mark W. McK. Bannatyne, Fragkiskos Papadopoulo, Ugo Erra, Veronica Rossano, Anna Ursyn, Alfredo Cuzzocrea, Rita Francese
Place of Publication	Piscataway
Publisher	Institute of Electrical and Electronics Engineers (IEEE)
Pages	145-152
Number of pages	8
ISBN (Electronic)	9781538672020
DOIs	https://doi.org/10.1109/iV.2018.00035
Publication status	Published - 5 Dec 2018
Event	22nd International Conference Information Visualisation - Biomedical Visualization, Visualisation on Built and Rural Environments and Geometric Modelling and Imaging, IV 2018 - Salerno, Italy Duration: 10 Jul 2018 → 13 Jul 2018

Conference

Conference	22nd International Conference Information Visualisation - Biomedical Visualization, Visualisation on Built and Rural Environments and Geometric Modelling and Imaging, IV 2018
Country/Territory	Italy
City	Salerno
Period	10/07/18 → 13/07/18

Keywords

Assessment
Evaluation
Performance
Usability
User Experience
Visualization

Access to Document

10.1109/iV.2018.00035Licence: Unspecified

Cite this

Figueiras, A. (2018). A review of visualization assessment in terms of user performance and experience. In J. M. Pires, N. M. S. Datia, G. Polese, M. Temperini, F. Sciarrone, M. Risi, G. Venturini, T. Di Mascio, R. Zaccagnino, V. Deufemia, D. Malandrino, P. Diaz, A. F. Anta, E. Banissi, T. G. Wyeld, M. Sarfraz, F. Bouali, M. W. M. Bannatyne, F. Papadopoulo, U. Erra, V. Rossano, A. Ursyn, A. Cuzzocrea, ... R. Francese (Eds.), Information Visualisation - Biomedical Visualization, Visualisation on Built and Rural Environments and Geometric Modelling and Imaging, IV 2018 (pp. 145-152). Article 8564153 Institute of Electrical and Electronics Engineers (IEEE). https://doi.org/10.1109/iV.2018.00035

Figueiras, Ana. / A review of visualization assessment in terms of user performance and experience. Information Visualisation - Biomedical Visualization, Visualisation on Built and Rural Environments and Geometric Modelling and Imaging, IV 2018. editor / Joao Moura Pires ; Nuno Miguel Soares Datia ; Giuseppe Polese ; Marco Temperini ; Filippo Sciarrone ; Michele Risi ; Gilles Venturini ; Tania Di Mascio ; Rocco Zaccagnino ; Vincenzo Deufemia ; Delfina Malandrino ; Paloma Diaz ; Antonio Fernandez Anta ; Ebad Banissi ; Theodor G. Wyeld ; Muhammad Sarfraz ; Fatma Bouali ; Mark W. McK. Bannatyne ; Fragkiskos Papadopoulo ; Ugo Erra ; Veronica Rossano ; Anna Ursyn ; Alfredo Cuzzocrea ; Rita Francese. Piscataway : Institute of Electrical and Electronics Engineers (IEEE), 2018. pp. 145-152

@inproceedings{af63ac037d9b48c39839c89a5218e934,

title = "A review of visualization assessment in terms of user performance and experience",

abstract = "Traditionally, information visualization research tends to focus only on performance related metrics such as task completion time and correctness. However, a recent interest on goals such as memorability, engagement, and fun has also sparked. We propose a reflection on visualization assessment supported by a profound analysis of research that includes user studies of visualization tools and techniques. The motivation for this study is to explore the possible benefits of having a unified standardized metric for usability and user experience that can become a clearer quantitative model of both. Such a metric can provide visualization researchers and practitioners a more succinct and accurate way to assess their visualizations.",

keywords = "Assessment, Evaluation, Performance, Usability, User Experience, Visualization",

author = "Ana Figueiras",

note = "UID/CCI/04667/2016; 22nd International Conference Information Visualisation - Biomedical Visualization, Visualisation on Built and Rural Environments and Geometric Modelling and Imaging, IV 2018 ; Conference date: 10-07-2018 Through 13-07-2018",

year = "2018",

month = dec,

day = "5",

doi = "10.1109/iV.2018.00035",

language = "English",

pages = "145--152",

editor = "Pires, {Joao Moura} and Datia, {Nuno Miguel Soares} and Giuseppe Polese and Marco Temperini and Filippo Sciarrone and Michele Risi and Gilles Venturini and {Di Mascio}, Tania and Rocco Zaccagnino and Vincenzo Deufemia and Delfina Malandrino and Paloma Diaz and Anta, {Antonio Fernandez} and Ebad Banissi and Wyeld, {Theodor G.} and Muhammad Sarfraz and Fatma Bouali and Bannatyne, {Mark W. McK.} and Fragkiskos Papadopoulo and Ugo Erra and Veronica Rossano and Anna Ursyn and Alfredo Cuzzocrea and Rita Francese",

booktitle = "Information Visualisation - Biomedical Visualization, Visualisation on Built and Rural Environments and Geometric Modelling and Imaging, IV 2018",

publisher = "Institute of Electrical and Electronics Engineers (IEEE)",

address = "United States",

}

Figueiras, A 2018, A review of visualization assessment in terms of user performance and experience. in JM Pires, NMS Datia, G Polese, M Temperini, F Sciarrone, M Risi, G Venturini, T Di Mascio, R Zaccagnino, V Deufemia, D Malandrino, P Diaz, AF Anta, E Banissi, TG Wyeld, M Sarfraz, F Bouali, MWM Bannatyne, F Papadopoulo, U Erra, V Rossano, A Ursyn, A Cuzzocrea & R Francese (eds), Information Visualisation - Biomedical Visualization, Visualisation on Built and Rural Environments and Geometric Modelling and Imaging, IV 2018., 8564153, Institute of Electrical and Electronics Engineers (IEEE), Piscataway, pp. 145-152, 22nd International Conference Information Visualisation - Biomedical Visualization, Visualisation on Built and Rural Environments and Geometric Modelling and Imaging, IV 2018, Salerno, Italy, 10/07/18. https://doi.org/10.1109/iV.2018.00035

A review of visualization assessment in terms of user performance and experience. / Figueiras, Ana.
Information Visualisation - Biomedical Visualization, Visualisation on Built and Rural Environments and Geometric Modelling and Imaging, IV 2018. ed. / Joao Moura Pires; Nuno Miguel Soares Datia; Giuseppe Polese; Marco Temperini; Filippo Sciarrone; Michele Risi; Gilles Venturini; Tania Di Mascio; Rocco Zaccagnino; Vincenzo Deufemia; Delfina Malandrino; Paloma Diaz; Antonio Fernandez Anta; Ebad Banissi; Theodor G. Wyeld; Muhammad Sarfraz; Fatma Bouali; Mark W. McK. Bannatyne; Fragkiskos Papadopoulo; Ugo Erra; Veronica Rossano; Anna Ursyn; Alfredo Cuzzocrea; Rita Francese. Piscataway: Institute of Electrical and Electronics Engineers (IEEE), 2018. p. 145-152 8564153.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A review of visualization assessment in terms of user performance and experience

AU - Figueiras, Ana

N1 - UID/CCI/04667/2016

PY - 2018/12/5

Y1 - 2018/12/5

N2 - Traditionally, information visualization research tends to focus only on performance related metrics such as task completion time and correctness. However, a recent interest on goals such as memorability, engagement, and fun has also sparked. We propose a reflection on visualization assessment supported by a profound analysis of research that includes user studies of visualization tools and techniques. The motivation for this study is to explore the possible benefits of having a unified standardized metric for usability and user experience that can become a clearer quantitative model of both. Such a metric can provide visualization researchers and practitioners a more succinct and accurate way to assess their visualizations.

AB - Traditionally, information visualization research tends to focus only on performance related metrics such as task completion time and correctness. However, a recent interest on goals such as memorability, engagement, and fun has also sparked. We propose a reflection on visualization assessment supported by a profound analysis of research that includes user studies of visualization tools and techniques. The motivation for this study is to explore the possible benefits of having a unified standardized metric for usability and user experience that can become a clearer quantitative model of both. Such a metric can provide visualization researchers and practitioners a more succinct and accurate way to assess their visualizations.

KW - Assessment

KW - Evaluation

KW - Performance

KW - Usability

KW - User Experience

KW - Visualization

UR - http://www.scopus.com/inward/record.url?scp=85060161932&partnerID=8YFLogxK

UR - https://apps.webofknowledge.com/InboundService.do?product=WOS&Func=Frame&DestFail=https%3A%2F%2Fwww.webofknowledge.com&SrcApp=RRC&locale=en_US&SrcAuth=RRC&SID=E4ljJsntwsDARslSnEc&customersID=RRC&mode=FullRecord&IsProductCode=Yes&Init=Yes&action=retrieve&UT=WOS%3A000460565700026

U2 - 10.1109/iV.2018.00035

DO - 10.1109/iV.2018.00035

M3 - Conference contribution

AN - SCOPUS:85060161932

SP - 145

EP - 152

BT - Information Visualisation - Biomedical Visualization, Visualisation on Built and Rural Environments and Geometric Modelling and Imaging, IV 2018

A2 - Pires, Joao Moura

A2 - Datia, Nuno Miguel Soares

A2 - Polese, Giuseppe

A2 - Temperini, Marco

A2 - Sciarrone, Filippo

A2 - Risi, Michele

A2 - Venturini, Gilles

A2 - Di Mascio, Tania

A2 - Zaccagnino, Rocco

A2 - Deufemia, Vincenzo

A2 - Malandrino, Delfina

A2 - Diaz, Paloma

A2 - Anta, Antonio Fernandez

A2 - Banissi, Ebad

A2 - Wyeld, Theodor G.

A2 - Sarfraz, Muhammad

A2 - Bouali, Fatma

A2 - Bannatyne, Mark W. McK.

A2 - Papadopoulo, Fragkiskos

A2 - Erra, Ugo

A2 - Rossano, Veronica

A2 - Ursyn, Anna

A2 - Cuzzocrea, Alfredo

A2 - Francese, Rita

PB - Institute of Electrical and Electronics Engineers (IEEE)

CY - Piscataway

T2 - 22nd International Conference Information Visualisation - Biomedical Visualization, Visualisation on Built and Rural Environments and Geometric Modelling and Imaging, IV 2018

Y2 - 10 July 2018 through 13 July 2018

ER -

Figueiras A. A review of visualization assessment in terms of user performance and experience. In Pires JM, Datia NMS, Polese G, Temperini M, Sciarrone F, Risi M, Venturini G, Di Mascio T, Zaccagnino R, Deufemia V, Malandrino D, Diaz P, Anta AF, Banissi E, Wyeld TG, Sarfraz M, Bouali F, Bannatyne MWM, Papadopoulo F, Erra U, Rossano V, Ursyn A, Cuzzocrea A, Francese R, editors, Information Visualisation - Biomedical Visualization, Visualisation on Built and Rural Environments and Geometric Modelling and Imaging, IV 2018. Piscataway: Institute of Electrical and Electronics Engineers (IEEE). 2018. p. 145-152. 8564153 doi: 10.1109/iV.2018.00035

A review of visualization assessment in terms of user performance and experience

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this