works

SoundThrow is a video tracking spatial audio controller for Macintosh written in the Spring of 2003. The audio output was coded entirely using the CoreAudio Java API. Video capture and analysis was handled with the Quicktime for Java API.

The initial intended use of the program is for articulation of spatialised sound for sound-diffusion performance of electroacoustic works. The program tracks the motion of a human hand in the frame of captured video from a web-cam or similar source. This tracking information is then used to spatialise a mono audio source file in up to 4-channel output. Image tracking is accomplished, at the user's choice, via colour tracking, sobel edge detection or differential edge detection. The audio spatialisation algorithm employed is also selectable by the user (variations on various trigonometric panning laws and vector based amplitude panning (VBAP) techniques are implemented).

soundThrow soundThrow soundThrow