« back to Publications
Tse, E., Greenberg, S. and Shen, C. (2006)
Exploring Interaction with Multi User Speech and Whole Handed Gestures on a Digital Table. In Adjunct Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2006), October 15–18, Montreux, Switzerland. Includes minute madness video, duration 0:57.
Type: Refereed conference (short paper / demonstration). Additional materials: minute madness video.
Download as: Pdf
Additional materials: Video (Minute madness presentation)
Abstract.
While highly collaborative environments involve the use of speech and rich whole handed gestures, current operating systems assume that there will only be one person interacting with the computer at any given time using a keyboard and a mouse over an upright display. In this demonstration we explore interaction with multi user speech and whole handed gestures on a digital table. We illustrate the interaction potential of three different single user computer games: Warcraft III, The Sims and Virtual Surgery. Our examples illustrate how multi user multimodal interaction can mimic some of the affordances traditionally seen when manipulating physical objects (such as a racing wheel in an arcade).
Keywords: Multimodal Interaction, Co-located Interaction and Tabletop Interaction, Whole handed gestures, Verbal Alouds.
