Multisensory HCI Design with Smell and Taste for Environmental Health Communication

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


In the field of Multisensory Human-Computer Interaction (HCI) Design, integration of chemical senses has been increasingly explored. Nevertheless, smell and taste senses are still underrepresented in HCI. This underrepresentation limits Environmental Health Communication, which should incorporate those senses. The exploratory study presented in this paper describes Multisensory HCI design process with the chemical senses as mediators of environmental health communication. To do so we formulated design hypothesis and divided our research design process into two phases: the chemical sense experience for cross-sensory analogies research and the digital media experience for meaning and communication research. Thereby, we describe the conceptualization, design and evaluation of our design project Earthsensum. Our approach accomplished symbolic displaying of smell and taste and led us to a new multi-sensorial interaction system using Mobile Virtual Reality (MVR) and Mobile Augmented Reality (MAR). The results of our findings confirmed our design hypothesis, and showed that the purposed interaction system lead not only to a better understanding of smell and taste perception, as well as of environmental challenges. We discuss our results in the context of the HCI design strategies for chemical senses inclusion.

Original languageEnglish
Title of host publicationHCI International 2020 - Late Breaking Papers: User Experience Design and Case Studies - 22nd HCI International Conference, HCII 2020, Proceedings
EditorsConstantine Stephanidis, Aaron Marcus, Elizabeth Rosenzweig, Pei-Luen Patrick Rau, Abbas Moallem, Matthias Rauterberg
Place of PublicationCham
Number of pages23
ISBN (Electronic)978-3-030-60114-0
ISBN (Print)978-3-030-60113-3
Publication statusPublished - 2020
Event22nd International Conference on Human-Computer Interaction,HCII 2020 - Copenhagen, Denmark
Duration: 19 Jul 202024 Jul 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12423 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference22nd International Conference on Human-Computer Interaction,HCII 2020


  • Chemical senses
  • Environmental health communication
  • Mobile augmented reality
  • Mobile virtual reality
  • Multisensory HCI design
  • Sustainable HCI


Dive into the research topics of 'Multisensory HCI Design with Smell and Taste for Environmental Health Communication'. Together they form a unique fingerprint.

Cite this