« back to Publications
Tse, E., Hancock, M. and Greenberg, S. (2007)
Speech-Filtered Bubble Ray: Improving Target Acquisition on Display Walls. In Proc 9th Int’l Conf. Multimodal Interfaces (ACM ICMI’07). (Nagoya, Japan), ACM Press, pages 307-314, November 12-15.
Type: Refereed conference (full paper).
Earlier version: Report 2007-867-19, June.
Additional materials: publicly presented video, minute madness presentation.
DOI: 10.1145/1322192.1322245
Download as: Pdf
Additional download: 
Powerpoint
Abstract.
The rapid development of large interactive wall displays has been accompanied by research on methods that allow people to interact with the display at a distance. The basic method for target acquisition is by ray casting a cursor from one’s pointing finger or hand position; the problem is that selection is slow and error-prone with small targets. A better method is the bubble cursor that resizes the cursor’s activation area to effectively enlarge the target size. The catch is that this technique’s effectiveness depends on the proximity of surrounding targets: while beneficial in sparse spaces, it is less so when targets are densely packed together. Our method is the speech-filtered bubble ray that uses speech to transform a dense target space into a sparse one. Our strategy builds on what people already do: people pointing to distant objects in a physical workspace typically disambiguate their choice through speech. In a controlled evaluation, people were faster and preferred using the speech-filtered bubble ray over the standard bubble ray and ray casting approach.
Keywords: Large display walls, speech, gestures, speech filtering, multimodal, freehand interaction, pointing.