Role-Separated Live Movement Sonification: Toolkits as Mediators of Distributed Agency in Performance

Michael Reichmann; Vincent van Rheden; Alexander Meschtscherjakov

Role-Separated Live Movement Sonification: Toolkits as Mediators of Distributed Agency in Performance
Image credit: Michael Reichmann; Vincent van Rheden; Alexander Meschtscherjakov

Abstract:

Real-time movement sonification in dance is typically framed as a problem of gesture-to-sound mapping. However, when mappings are reconfigured during live performance, sonification systems do more than translate motion data. They reorganize participation, timing and agency within the performance ecology. This paper examines a role-separated live configuration in which a dancer (mover) performed while an operator (mapper) adjusted movement-to-sound relationships in real-time using a sonification toolkit implemented in Max. The case was developed during a ten-day workshop and presented in two public performances. Adopting a Research-through-Design (RtD) methodology, the enacted configuration is treated as a research artifact. We introduce a conceptual interaction model describing sonification toolkits as mediators of distributed agency across mover, mapper and coupling environment. A reflective case analysis compares first-person accounts from both roles to articulate recurring interactional structures across the performance. The contribution lies in reframing live sonification toolkits as collaborative performance interfaces. The findings demonstrate how real-time mapping reconfiguration structures mutual engagement and redistributes control, offering design considerations for movement-to-sound coupling environments in artistic contexts.