Par
Marine Gaillet
&
Jean Buchet
FR | ENG
BVR_SND is an immersive installation that transforms the human body into a musical control interface. A camera captures your movements in real time, which are analyzed by TouchDesigner to control an external synthesizer and trigger additional sounds. With no physical interface, you compose music solely through your gestures, creating an experience where your entire body becomes a giant, expressive instrument.
Objective :
Create direct interaction where each movement produces an immediate sound reaction. The installation offers an intuitive exploration of sound creation, accessible without prior musical knowledge.
Gestures :
Left hand → Synthesizer filter frequency
The higher the hand rises, the more the filter opens, allowing high harmonics to pass through.
Right hand → Filter resonance
Control modulation for textures ranging from smooth to saturated.
Distance between hands → MP3 trigger
Active separation of additional sound layers according to the amplitude of the gesture.
Left leg → Its independent MP3 player
Above a defined threshold, a percussive or rhythmic sound is triggered.
Nose → LFO speed on volume
Head movements create organic pulsations, like audible breathing.
Technique :
The system is based on video tracking that analyzes the positions (X, Y, Z) of the hands, nose, and legs. This data controls the external synthesizer via MIDI for real-time control of the filter, resonance, and volume. Certain sounds (MP3) are played directly in TouchDesigner, enriching the sound palette beyond the capabilities of the synthesizer.