Improving usability with think aloud and focus group methods. A case study: an intelligent police patrolling system (i-PAT)

Tania Calle-Jimenez, Doris Tutillo-Sanchez, Sandra Sanchez-Gordon, Janio Jadán-Guerrero, Cesar Guevara, Patricio Lara-Alvarez, Patricia Acosta-Vargas, Luis Salvador-Ullauri, Isabel L. Nunes

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This study proposes the use of Think Aloud and Focus Group methods for evaluating the usability of the Intelligent Police Patrolling System (I-Pat). The study was conducted with twenty-one students of computer engineering. The study included two evaluation methods. First, the application of Think Aloud using audio recordings, image capturing and questionnaires. Second, the application of a Focus Group for brainstorming. The total number of the usability problems identified was fifteen. Comprehensiveness (46%) and layout (43%) problems were the most frequently found. The study showed that the problems encountered were due to the lack of understanding of the system’s functions, so it is recommended increasing the users’ levels of knowledge about the system. The application of these methods caused the students to find a greater number of errors than when applying a single method, allowing them to generate a report with usability improvements according to the reported errors.

Original languageEnglish
Title of host publicationAdvances in Human Factors and Systems Interaction - Proceedings of the AHFE 2019 International Conference on Human Factors and Systems Interaction
EditorsIsabel L. Nunes
Place of PublicationCham
PublisherSpringer Verlag
Pages361-373
Number of pages13
ISBN (Electronic)978-3-030-20040-4
ISBN (Print)978-3-030-20039-8
DOIs
Publication statusPublished - 1 Jan 2020
EventAHFE International Conference on Human Factors and Systems Interaction, 2019 - Washington D.C., United States
Duration: 24 Jul 201928 Jul 2019

Publication series

NameAdvances in Intelligent Systems and Computing
PublisherSpringer Verlag
Volume959
ISSN (Print)2194-5357

Conference

ConferenceAHFE International Conference on Human Factors and Systems Interaction, 2019
CountryUnited States
CityWashington D.C.
Period24/07/1928/07/19

Fingerprint

Law enforcement
Audio recordings
Students

Keywords

  • Focus Group
  • I-Path
  • Patrolling
  • Think Aloud
  • Usability

Cite this

Calle-Jimenez, T., Tutillo-Sanchez, D., Sanchez-Gordon, S., Jadán-Guerrero, J., Guevara, C., Lara-Alvarez, P., ... Nunes, I. L. (2020). Improving usability with think aloud and focus group methods. A case study: an intelligent police patrolling system (i-PAT). In I. L. Nunes (Ed.), Advances in Human Factors and Systems Interaction - Proceedings of the AHFE 2019 International Conference on Human Factors and Systems Interaction (pp. 361-373). (Advances in Intelligent Systems and Computing; Vol. 959). Cham: Springer Verlag. https://doi.org/10.1007/978-3-030-20040-4_33
Calle-Jimenez, Tania ; Tutillo-Sanchez, Doris ; Sanchez-Gordon, Sandra ; Jadán-Guerrero, Janio ; Guevara, Cesar ; Lara-Alvarez, Patricio ; Acosta-Vargas, Patricia ; Salvador-Ullauri, Luis ; Nunes, Isabel L. / Improving usability with think aloud and focus group methods. A case study: an intelligent police patrolling system (i-PAT). Advances in Human Factors and Systems Interaction - Proceedings of the AHFE 2019 International Conference on Human Factors and Systems Interaction. editor / Isabel L. Nunes. Cham : Springer Verlag, 2020. pp. 361-373 (Advances in Intelligent Systems and Computing).
@inproceedings{60d14fa26de84226aef50959b35a4f80,
title = "Improving usability with think aloud and focus group methods. A case study: an intelligent police patrolling system (i-PAT)",
abstract = "This study proposes the use of Think Aloud and Focus Group methods for evaluating the usability of the Intelligent Police Patrolling System (I-Pat). The study was conducted with twenty-one students of computer engineering. The study included two evaluation methods. First, the application of Think Aloud using audio recordings, image capturing and questionnaires. Second, the application of a Focus Group for brainstorming. The total number of the usability problems identified was fifteen. Comprehensiveness (46{\%}) and layout (43{\%}) problems were the most frequently found. The study showed that the problems encountered were due to the lack of understanding of the system’s functions, so it is recommended increasing the users’ levels of knowledge about the system. The application of these methods caused the students to find a greater number of errors than when applying a single method, allowing them to generate a report with usability improvements according to the reported errors.",
keywords = "Focus Group, I-Path, Patrolling, Think Aloud, Usability",
author = "Tania Calle-Jimenez and Doris Tutillo-Sanchez and Sandra Sanchez-Gordon and Janio Jad{\'a}n-Guerrero and Cesar Guevara and Patricio Lara-Alvarez and Patricia Acosta-Vargas and Luis Salvador-Ullauri and Nunes, {Isabel L.}",
year = "2020",
month = "1",
day = "1",
doi = "10.1007/978-3-030-20040-4_33",
language = "English",
isbn = "978-3-030-20039-8",
series = "Advances in Intelligent Systems and Computing",
publisher = "Springer Verlag",
pages = "361--373",
editor = "Nunes, {Isabel L.}",
booktitle = "Advances in Human Factors and Systems Interaction - Proceedings of the AHFE 2019 International Conference on Human Factors and Systems Interaction",
address = "Germany",

}

Calle-Jimenez, T, Tutillo-Sanchez, D, Sanchez-Gordon, S, Jadán-Guerrero, J, Guevara, C, Lara-Alvarez, P, Acosta-Vargas, P, Salvador-Ullauri, L & Nunes, IL 2020, Improving usability with think aloud and focus group methods. A case study: an intelligent police patrolling system (i-PAT). in IL Nunes (ed.), Advances in Human Factors and Systems Interaction - Proceedings of the AHFE 2019 International Conference on Human Factors and Systems Interaction. Advances in Intelligent Systems and Computing, vol. 959, Springer Verlag, Cham, pp. 361-373, AHFE International Conference on Human Factors and Systems Interaction, 2019, Washington D.C., United States, 24/07/19. https://doi.org/10.1007/978-3-030-20040-4_33

Improving usability with think aloud and focus group methods. A case study: an intelligent police patrolling system (i-PAT). / Calle-Jimenez, Tania; Tutillo-Sanchez, Doris; Sanchez-Gordon, Sandra; Jadán-Guerrero, Janio; Guevara, Cesar; Lara-Alvarez, Patricio; Acosta-Vargas, Patricia; Salvador-Ullauri, Luis; Nunes, Isabel L.

Advances in Human Factors and Systems Interaction - Proceedings of the AHFE 2019 International Conference on Human Factors and Systems Interaction. ed. / Isabel L. Nunes. Cham : Springer Verlag, 2020. p. 361-373 (Advances in Intelligent Systems and Computing; Vol. 959).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Improving usability with think aloud and focus group methods. A case study: an intelligent police patrolling system (i-PAT)

AU - Calle-Jimenez, Tania

AU - Tutillo-Sanchez, Doris

AU - Sanchez-Gordon, Sandra

AU - Jadán-Guerrero, Janio

AU - Guevara, Cesar

AU - Lara-Alvarez, Patricio

AU - Acosta-Vargas, Patricia

AU - Salvador-Ullauri, Luis

AU - Nunes, Isabel L.

PY - 2020/1/1

Y1 - 2020/1/1

N2 - This study proposes the use of Think Aloud and Focus Group methods for evaluating the usability of the Intelligent Police Patrolling System (I-Pat). The study was conducted with twenty-one students of computer engineering. The study included two evaluation methods. First, the application of Think Aloud using audio recordings, image capturing and questionnaires. Second, the application of a Focus Group for brainstorming. The total number of the usability problems identified was fifteen. Comprehensiveness (46%) and layout (43%) problems were the most frequently found. The study showed that the problems encountered were due to the lack of understanding of the system’s functions, so it is recommended increasing the users’ levels of knowledge about the system. The application of these methods caused the students to find a greater number of errors than when applying a single method, allowing them to generate a report with usability improvements according to the reported errors.

AB - This study proposes the use of Think Aloud and Focus Group methods for evaluating the usability of the Intelligent Police Patrolling System (I-Pat). The study was conducted with twenty-one students of computer engineering. The study included two evaluation methods. First, the application of Think Aloud using audio recordings, image capturing and questionnaires. Second, the application of a Focus Group for brainstorming. The total number of the usability problems identified was fifteen. Comprehensiveness (46%) and layout (43%) problems were the most frequently found. The study showed that the problems encountered were due to the lack of understanding of the system’s functions, so it is recommended increasing the users’ levels of knowledge about the system. The application of these methods caused the students to find a greater number of errors than when applying a single method, allowing them to generate a report with usability improvements according to the reported errors.

KW - Focus Group

KW - I-Path

KW - Patrolling

KW - Think Aloud

KW - Usability

UR - http://www.scopus.com/inward/record.url?scp=85067362554&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-20040-4_33

DO - 10.1007/978-3-030-20040-4_33

M3 - Conference contribution

SN - 978-3-030-20039-8

T3 - Advances in Intelligent Systems and Computing

SP - 361

EP - 373

BT - Advances in Human Factors and Systems Interaction - Proceedings of the AHFE 2019 International Conference on Human Factors and Systems Interaction

A2 - Nunes, Isabel L.

PB - Springer Verlag

CY - Cham

ER -

Calle-Jimenez T, Tutillo-Sanchez D, Sanchez-Gordon S, Jadán-Guerrero J, Guevara C, Lara-Alvarez P et al. Improving usability with think aloud and focus group methods. A case study: an intelligent police patrolling system (i-PAT). In Nunes IL, editor, Advances in Human Factors and Systems Interaction - Proceedings of the AHFE 2019 International Conference on Human Factors and Systems Interaction. Cham: Springer Verlag. 2020. p. 361-373. (Advances in Intelligent Systems and Computing). https://doi.org/10.1007/978-3-030-20040-4_33