Gaze-guided narratives: Adapting audio guide content to gaze in virtual and real environments

Tiffany C.K. Kwok, Peter Kiefer, Victor R. Schinazi, Benjamin Adams, Martin Raubal

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

2 Citations (Scopus)

Abstract

Exploring a city panorama from a vantage point is a popular tourist activity. Typical audio guides that support this activity are limited by their lack of responsiveness to user behavior and by the difficulty of matching audio descriptions to the panorama. These limitations can inhibit the acquisition of information and negatively affect user experience. This paper proposes Gaze-Guided Narratives as a novel interaction concept that helps tourists find specific features in the panorama (gaze guidance) while adapting the audio content to what has been previously looked at (content adaptation). Results from a controlled study in a virtual environment (n=60) revealed that a system featuring both gaze guidance and content adaptation obtained better user experience, lower cognitive load, and led to better performance in a mapping task compared to a classic audio guide. A second study with tourists situated at a vantage point (n=16) further demonstrated the feasibility of this approach in the real world.

Original languageEnglish
Title of host publicationCHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems
Place of PublicationGlasgow
PublisherAssociation for Computing Machinery (ACM)
ISBN (Electronic)9781450359702
DOIs
Publication statusPublished - 2 May 2019
Externally publishedYes
EventACM CHI Conference on Human Factors in Computing Systems: Weaving the Threads of CHI - Glasgow, United Kingdom
Duration: 4 May 20199 May 2019
https://chi2019.acm.org/

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

ConferenceACM CHI Conference on Human Factors in Computing Systems
Abbreviated titleCHI 2019
CountryUnited Kingdom
CityGlasgow
Period4/05/199/05/19
OtherThe ACM CHI Conference on Human Factors in Computing Systems is the premier international conference of Human-Computer Interaction. CHI – pronounced ‘kai’ – is a place where researchers and practitioners gather from across the world to discuss the latest in interactive technology. We are a multicultural community from highly diverse backgrounds who together investigate new and creative ways for people to interact. CHI 2019 was the first time that CHI has taken place in the UK and was hosted at the Scottish Event Campus in Glasgow.

Our theme was ‘Weaving the Threads of CHI’. This is reflected in our celtic knot logo, a symbol of strength and friendship. Threads are interconnected and interwoven, without clear beginning or end. We are the threads of CHI, people from different disciplines, cultures, sectors, communities, backgrounds – designers, researchers, practitioners – weaving together into one community, with the common purpose of technology that works for people and society.
Internet address

Fingerprint Dive into the research topics of 'Gaze-guided narratives: Adapting audio guide content to gaze in virtual and real environments'. Together they form a unique fingerprint.

  • Cite this

    Kwok, T. C. K., Kiefer, P., Schinazi, V. R., Adams, B., & Raubal, M. (2019). Gaze-guided narratives: Adapting audio guide content to gaze in virtual and real environments. In CHI '19: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems [491] (Conference on Human Factors in Computing Systems - Proceedings). Glasgow: Association for Computing Machinery (ACM). https://doi.org/10.1145/3290605.3300721