2014-Brudy-MSc

« back to Publications

Brudy, F. (2014)
Is Anyone Looking? Mitigating Shoulder Surfing on Public Displays through Awareness and Protection. Master’s thesis, Institut für Informatik, Ludwig-Maximilians-Universität München, Munich, Germany, March.
Type: Masters thesis.
Note: Brudy was under my supervision (thesis reviewed by Andreas Butz, LMU).
See also: ACM SIGCHI Video Showcase for a video illustrating this work.

Download as: Pdf

Abstract.
When a person interacts with a display in open areas, information on the screen – which may be sensitive, personal and private – may be visible to anyone passing by. With small displays, a person’s body suffices to shield that information from others, but this approach becomes increasingly ineffective as the display area increases (e.g., from large workstation screens, to multiple monitors, to wall-sized displays). This is especially problematic in public areas, as a person may be unaware that a stranger is present and looking over one’s shoulder. To mitigate this problem, in this work proxemic relationships between the passerby, the person and the display are used to provide the person with both awareness of onlookers, and mechanisms to manually or automatically protect information by muting or covering sensitive content. Awareness of passerby’s and onlookers is provided through visual cues, which range from flashing the borders of the screen, to a 3D model mirroring a passerby’s position and gaze, to an indicator that illustrates the gaze direction of the onlooker on the screen the onlooker. The same information signals the onlookers that they may be intruding, where – if they obey social protocol – they then turn away. A person may act on that awareness information by performing a gesture that covers sensitive applications: by blacking out windows, or by moving them to one side. Alternately, the system can automatically darken screen regions that cover those display area visible by the onlooker, while leaving the display area shielded by the person’s body unaltered (thus allowing the person to continue their actions). The person may also invite the person in for collaboration by explicitly turning off these protective mechanisms with a gesture.

Scroll to Top