Gestural interfaces require a visible, immediate correspondence between the performer's movements and the audiovisual output

When a performer uses bodily gestures to control visuals, the audience expects causal legibility: the gesture should visibly produce a corresponding change in the output. Without this correspondence, gestural performance feels arbitrary or like playback — the same problem laptop performers face with a mouse. The analogy is a piano: pressing a key produces a specific sound immediately, and playing faster accelerates the music. Gestural interfaces that lack this tight mapping confuse and disengage audiences. The challenge is designing mappings that are both expressively rich and perceptually transparent to viewers who cannot see the control data.

Examples

In a piano concert, faster keystrokes produce faster music — immediately legible. A data-glove controlling generative visuals should map specific gestures to specific visual responses (e.g. open hand = expand scale, closed fist = freeze).

Assessment

Design a gestural mapping for controlling a live visual patch with one hand. For each gesture, specify the corresponding visual parameter and explain why the mapping would be legible to an audience.