TY - GEN
T1 - Exploring the User Interaction with a Multimodal Web-Based Video Annotator
AU - Rodrigues, Rui
AU - Madeira, Rui Neves
AU - Correia, Nuno
N1 - Funding Information:
info:eu-repo/grantAgreement/FCT/OE/2020.09417.BD/PT#
Supported by the project CultureMoves, Grant Agreement Number: INEA/CEF/ICT/A2017/1568369. It is also supported by NOVA LINCS RC, partially funded by project UID/CEC/04516/2020 granted by FCT.
Publisher Copyright:
© 2022, ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering.
PY - 2022
Y1 - 2022
N2 - People interact with their surroundings using several multimodal methods. Human-computer interaction is performed using these capabilities in order to provide, as much as possible, the most natural and productive experiences through speech, touch, vision, and gesture. The Web-based application used in this paper is a multi-platform video annotation tool that supports multimodal interaction. MotionNotes has the primary goal of fostering the creativity of both professional and amateur users. It is possible to interact with this tool using keyboard, touch, and voice, making it possible to add different types of annotations: voice, drawings, text, and marks. Furthermore, a feature of human poses identification in real-time was integrated into the annotation tool, enabling the identification of possible annotations. This paper presents and discusses results from a user study conducted to explore the user interaction with the tool, evaluating the prototype and its different interaction methods. User feedback shows that this approach to video annotation is stimulating and can enhance the user’s creativity and productivity.
AB - People interact with their surroundings using several multimodal methods. Human-computer interaction is performed using these capabilities in order to provide, as much as possible, the most natural and productive experiences through speech, touch, vision, and gesture. The Web-based application used in this paper is a multi-platform video annotation tool that supports multimodal interaction. MotionNotes has the primary goal of fostering the creativity of both professional and amateur users. It is possible to interact with this tool using keyboard, touch, and voice, making it possible to add different types of annotations: voice, drawings, text, and marks. Furthermore, a feature of human poses identification in real-time was integrated into the annotation tool, enabling the identification of possible annotations. This paper presents and discusses results from a user study conducted to explore the user interaction with the tool, evaluating the prototype and its different interaction methods. User feedback shows that this approach to video annotation is stimulating and can enhance the user’s creativity and productivity.
KW - HCI
KW - Multimodal interfaces
KW - Performing arts
KW - User study
KW - Video annotations
UR - http://www.scopus.com/inward/record.url?scp=85127713886&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-99188-3_2
DO - 10.1007/978-3-030-99188-3_2
M3 - Conference contribution
AN - SCOPUS:85127713886
SN - 978-3-030-99187-6
T3 - Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
SP - 13
EP - 22
BT - Intelligent Technologies for Interactive Entertainment - 13th EAI International Conference, INTETAIN 2021, Proceedings
A2 - Lv, Zhihan
A2 - Song, Houbing
PB - Springer
T2 - 13th EAI International Conference on Intelligent Technologies for Interactive Entertainment, INTETAIN 2021
Y2 - 3 December 2021 through 4 December 2021
ER -