Vision and hearing process time and density differently — AV artists must account for these asymmetries to achieve coherence

On a physiological level, seeing and hearing are fundamentally different. Seeing is a sequential act: one perception point (focus) roams across the scene at a time. Hearing is massively parallel: multiple streams (polyphony) are perceived simultaneously, integrated into timbre and overall sound. This has compositional consequences for live AV: the visual layer can only convey one spatial focus at a time, while the audio layer can sustain independent simultaneous streams. Synaesthetic correspondence (visual and audio fusing into a unified experience) rarely ‘just happens’ — it requires deliberate design. Temporal contrasts, structural change, abstraction level, and density must be calibrated differently for the eye and the ear. A coherent AV performance finds elements in one domain that relate to the other at an abstract or emotional level.

Examples

A bass pulse in audio (heard as continuous energy) must correspond to a visual element that registers as continuous energy to the eye — not necessarily synchronized to each beat, but with the same weight and rhythm. A polyphonic texture in audio (multiple simultaneous lines) needs visual counterparts that the eye can read simultaneously (e.g., multiple independent moving elements).

Assessment

A live AV piece has a dense polyrhythmic drum texture (4 simultaneous rhythmic layers) and a single moving circle on screen. Predict whether the AV will feel coherent or mismatched and explain why. Then propose a visual element that would better correspond to the density of the audio.