home/ modules/ visual-dataflow-and-audiovisual-tools

Visual dataflow and audiovisual live coding

  • learner can build a Pure Data patch understanding boxes, inlets and hot/cold order
  • learner can contrast visual patching with text-based live coding
  • learner can drive coupled audio and visuals from one notation (Hydra/Punctual)

Build a small Pure Data instrument (object/message/number boxes, trigger for ordering) and pair it with a Hydra/Punctual audiovisual sketch, then write a short note comparing dataflow patching to text-based live coding.

Most live coders eventually meet the other half of the real-time music world: the patcher rig. At an algorave or AV club night you will see performers wiring Pure Data on one screen while Hydra visuals pulse on the projector — and the strongest performers can move between paradigms, choosing text or cables per gig. This module builds exactly that dual fluency: a working Pd instrument, a coupled audiovisual sketch, and the critical vocabulary to say why each notation suits which stage.

The arc starts supported. First you absorb Pd as a real-time dataflow language, then drop your first object, message, and number boxes and wire outlets to inlets top-to-bottom. Add a tilde oscillator and you hit the signal-versus-control split — thick and thin cables, and why a bare number can’t feed an audio inlet. The selector-plus-arguments view of messages then demystifies bang, float, and set. The two recurrent skills you drill until automatic — always inside a working patch, not in isolation — are hot/cold inlet ordering and using trigger to force right-to-left firing, because a stale cold value is the classic Pd bug and the capstone instrument depends on getting it right. On the visual side, Hydra’s browser-based synthesis and Punctual’s single signal notation routed by >> let you couple sound and image from one grammar.

Every required atom is load-bearing: box mechanics, ordering discipline, and AV notation gate the build; the paradigm-contrast atoms gate the written comparison (including the sharp observation that patcher layout is secondary notation). Supporting atoms — Texture’s distance-as-syntax and the Web Audio stack beneath browser tools — deepen the comparison without being needed to finish.

Atoms in this module

Required — these gate the capstone

Pure Data is a real-time visual dataflow language where connected boxes replace text code
Concept L0 Orientation FN
Pd has object, message, and number boxes, with inlets always on top and outlets on bottom
Concept L1 Foundations FN
A trailing tilde marks Pd signal objects, distinguishing the audio level from the control level
Concept L1 Foundations FB
Every Pd message is a selector plus arguments, built from float, symbol, and pointer atoms
Concept L2 First instrument FN
A Pd object only fires from its leftmost (hot) inlet; other inlets are cold and merely store
Principle L2 First instrument FN
Pd's trigger object splits one input into typed outputs fired right to left
Procedure L2 First instrument FN
Patcher languages like Max and Pure Data are visually rich but their primary syntax ignores spatial position
Concept L2 First instrument FN
Visual dataflow patching (Max/Pd) builds instruments by wiring boxes, distinct from text-based live coding
Concept L1 Foundations FNO
Hydra is a browser-based live coding environment for visual synthesis, enabling collaborative networked visual performance
Fact L2 First instrument FHJ
Punctual uses the same signal notation for audio and visuals, routed by the >> target
Concept L2 First instrument FH

Supporting — enrichment, not gating

Texture uses Euclidean distance to automatically wire typed values to functions, making visuospatial layout syntactically significant
Concept L4 Performance FH
Web Audio API, WebMIDI, and Tone.js are the browser-native stack for interactive music apps
Fact L1 Foundations FA