« back to Publications
Diaz-Marino, R. (2008)
A Visual Programming Language for Live Video Sonification. Master’s thesis, Department of Computer Science, University of Calgary, Calgary, Alberta, Canada, March.
Type: Masters thesis.
Note: Diaz-Marino was under my supervision.
Download as: Pdf
Abstract.
The problem explored in this thesis is how to allow a person to map features from multiple video streams, or parts of those video streams, into an audio space, and how they can then monitor the resulting soundscape. I consider the requirements, user interface and architecture of a system that lets an end-user configure a video-only stream so that it generates an audio soundscape. In particular, I present a programming by demonstration environment called Cambience. Using this system, end users can map visual characteristics collected from video regions onto audio samples, and assemble the audio stream in a way that creates a meaningful soundscape. Cambience is used to mitigate a simple scenario between two distance separated collaborators and a shared resource. The wide range of visual programming elements allow for complex sonification behavior. Informal evaluations of the system show that Cambience has real usefulness with mostly minor considerations.