Exploring the User Interaction with a Multimodal Web-Based Video Annotator

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

People interact with their surroundings using several multimodal methods. Human-computer interaction is performed using these capabilities in order to provide, as much as possible, the most natural and productive experiences through speech, touch, vision, and gesture. The Web-based application used in this paper is a multi-platform video annotation tool that supports multimodal interaction. MotionNotes has the primary goal of fostering the creativity of both professional and amateur users. It is possible to interact with this tool using keyboard, touch, and voice, making it possible to add different types of annotations: voice, drawings, text, and marks. Furthermore, a feature of human poses identification in real-time was integrated into the annotation tool, enabling the identification of possible annotations. This paper presents and discusses results from a user study conducted to explore the user interaction with the tool, evaluating the prototype and its different interaction methods. User feedback shows that this approach to video annotation is stimulating and can enhance the user’s creativity and productivity.

Original languageEnglish
Title of host publicationIntelligent Technologies for Interactive Entertainment - 13th EAI International Conference, INTETAIN 2021, Proceedings
EditorsZhihan Lv, Houbing Song
PublisherSpringer
Pages13-22
Number of pages10
ISBN (Electronic)978-3-030-99188-3
ISBN (Print)978-3-030-99187-6
DOIs
Publication statusPublished - 2022
Event13th EAI International Conference on Intelligent Technologies for Interactive Entertainment, INTETAIN 2021 - Virtual, Online
Duration: 3 Dec 20214 Dec 2021

Publication series

NameLecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
PublisherSpringer, Cham
Volume429 LNICST
ISSN (Print)1867-8211
ISSN (Electronic)1867-822X

Conference

Conference13th EAI International Conference on Intelligent Technologies for Interactive Entertainment, INTETAIN 2021
CityVirtual, Online
Period3/12/214/12/21

Keywords

  • HCI
  • Multimodal interfaces
  • Performing arts
  • User study
  • Video annotations

Fingerprint

Dive into the research topics of 'Exploring the User Interaction with a Multimodal Web-Based Video Annotator'. Together they form a unique fingerprint.

Cite this