« back to Publications
Tse, E., Greenberg, S. and Shen, C. (2006)
Multi User Multimodal Tabletop Interaction over Existing Single User Applications. In Adjunct Proceedings of the ACM Conference on Computer Supported Cooperative Work – ACM CSCW 2006, ACM Press, November.
Type: Refereed conference (short paper / demonstration).
Download as: Pdf
Abstract.
In this demonstration we illustrate the behavioural foundations of natural speech and gesture interactions on a digital table in practice through the application of these principles to four existing single user applications: Google Earth, Warcraft, Sims and Virtual Surgery. We demonstrate verbal alouds, rich hand gestures, multimodal input, interleaving actions and requests for assistance/validation. By making actions public through speech and gesture interaction, we can improve consequential communication and the group’s common ground.
Keywords: Digital Tabletop Interaction, Multimodal Speech and Gesture Input, Behavioural Foundations.