Accessible Musical ALife Through LLM Co-Creation

Michael Clemens; Piotr Walas; Victor Shepardson; Jack Armitage

Accessible Musical ALife Through LLM Co-Creation
Image credit: Michael Clemens; Piotr Walas; Victor Shepardson; Jack Armitage

Abstract:

GPU-accelerated artificial life (ALife) simulations present possibilities for musical expression, yet building them demands programming fluency that excludes many musicians and sound artists. We present a natural language interface that translates behavioral descriptions into executable particle simulations with integrated Open Sound Control (OSC) output and auto-generated SuperCollider companion scripts. Through a preliminary evaluation across three frontier models, we observe that structured context engineering appears necessary for reliable code synthesis, while providing models with extensive documentation alone yielded no improvement over unassisted generation. The pipeline’s value lies in overcoming the cold start of generating domain specific languages, producing a first sketch for the artist to refine.