Tim Pohle, Gerhard Widmer, Peter Knees,
"sound/tracks: Real-Time Synaesthetic Sonification and Visualisation of Passing Landscapes."
: Proceedings of the ACM Multimedia 2008 - Interactive Arts Program, Vancouver, BC, Canada., 2008
Original Titel:
sound/tracks: Real-Time Synaesthetic Sonification and Visualisation of Passing Landscapes.
Sprache des Titels:
Englisch
Original Buchtitel:
Proceedings of the ACM Multimedia 2008 - Interactive Arts Program, Vancouver, BC, Canada.
Original Kurzfassung:
When travelling on a train, many people enjoy looking out
of the window at the landscape passing by. We present
sound/tracks, an application that translates the perceived
movement of the scenery and other visual impressions, such
as passing trains, into music. The continuously changing
view outside the window is captured with a camera and
translated intoMIDI events that are replayed instantaneously.
This allows for a reflection of the visual impression, adding
a sound dimension to the visual experience and deepening
the state of contemplation. The application is intended to
be run on both mobile phones (with built-in camera) and
on laptops (with a connected Web-cam). We propose and
discuss different approaches to translating the video signal
into an audio stream, present different application scenarios,
and introduce a method to visualise the dynamics of complete
train journeys by “re-transcribing” the captured video
frames used to generate the music.
Forschungs-