Selected work
Movement-driven audiovisual instrumentExperiment / PoC

Kinetica

An embodied audiovisual experiment that turns webcam-tracked movement into generative soundscapes and reactive GLSL shader fields—using the body as the instrument.

Visit live experiment
Your body becomes the interface, instrument, and visual controllerMovement-driven audiovisual instrumentExperiment / PoC
Kinetica title screen reading Move to Hear over a dark reactive field, inviting the visitor to begin a webcam-driven audiovisual experience.
The challenge

The experiment had to translate natural hand and body movement into musical controls that feel immediate and learnable, while keeping the camera feed private and entirely inside the browser.

The response

MediaPipe reads pose and hand landmarks from the webcam, then maps gesture, stance, and movement into layered soundscapes and GLSL shader uniforms across seven reactive visual worlds.