Real-time Timbral Analysis for Musical and Visual Augmentation

The Real-time Timbral Analysis for Musical and Visual Augmentation project explores the potential of real-time machine learning (ML) techniques to create dynamic visuals in the context of musical improvisation and composition. This artistic research aims to enable musicians to interact with visuals that respond directly to their performance, thereby guiding listeners' perception through visual representations of changes in timbre and spectrum. The project incorporates software tools such as sp.tools, FluCoMa, Max MSP, and TouchDesigner to achieve real-time instrumental augmentation for musicians, offering a unique way to visualize musical parameters.