Sounding Canvas: A Networked Social Artwork Bridging Distant Communities through Tactile Interaction

Luciano Ciamarone (Independent Researcher)*; Dora Motèque (Independent Researcher); Marco Giordano (University of L'Aquila)

Sounding Canvas: A Networked Social Artwork Bridging Distant Communities through Tactile Interaction
Image credit: Luciano Ciamarone (Independent Researcher)*; Dora Motèque (Independent Researcher); Marco Giordano (University of L'Aquila)

Abstract:

Sounding Canvas explores the concept of “augmented paintings”, traditional physical artworks embedded with an invisible electronic brain. The project stems from a “semiographic” research phase where visual shapes are used to generate dynamic sonic material. Participants engage directly with the canvas by touching its surface, initiating interactions that shape the resulting soundscapes in real time. Gestures are processed by an embedded software component called Event Manager, which can operate using either a Hidden-Order Markov Model or a Recurrent Neural Network to determine the canvas’ sonic responses. This design emphasizes the dialogue between human and machine, allowing users to experience the canvas as a semi-autonomous, responsive partner in the creative process. When multiple canvases are networked, this interaction extends across space: actions on one canvas influence the behavior of its counterpart, fostering a shared, collaborative experience that emphasizes non-verbal communication and social musicality. The system adapts continuously, responding to both individual gestures and remote events, creating a performance that is unique to each participant and session.