A Fuzzy Gestural AI Approach for Expressive Interactivity in Multitouch Digital Musical Instruments Based on Laban Descriptors

Simple item page
dc.contributor.authorGonzalez-Inostroza, Marie
dc.contributor.authorCadiz, Rodrigo F.
dc.date.accessioned2025-01-20T20:11:09Z
dc.date.available2025-01-20T20:11:09Z
dc.date.issued2023
dc.description.abstractOne of the main research areas in the field of musical human-AI interactivity is how to incorporate expressiveness into interactive digital musical instruments (DMIs). In this study we analyzed gestures rooted in expressiveness by using AI techniques that can enhance the mapping stage of multitouch DMIs. This approach not only considers the geometric information of various gestures but also incorporates expressiveness, which is a crucial element of musicality. Our focus is specifically on multitouch DMIs, and we use expressive descriptors and a fuzzy logic model to mathematically analyze performers' finger movements. By incorporating commonly used features from the literature and adapting some of Rudolf Laban's descriptors-originally intended for full-body analysis-to finger-based multitouch systems, we aim to enrich the mapping process. To achieve this, we developed an AI algorithm based on a fuzzy control system that takes these descriptors as inputs and maps them to synthesis variables. This tool empowers DMI designers to define their own mapping rules based on expressive gestural descriptions, using musical metaphors in a simple and intuitive way. Through a user evaluation, we demonstrate the effectiveness of our approach in capturing and representing gestural expressiveness in the case of multitouch DMIs.
dc.fuente.origenWOS
dc.identifier.doi10.1162/comj_a_00673
dc.identifier.eissn1531-5169
dc.identifier.issn0148-9267
dc.identifier.urihttps://doi.org/10.1162/comj_a_00673
dc.identifier.urihttps://repositorio.uc.cl/handle/11534/92124
dc.identifier.wosidWOS:001262355500006
dc.issue.numero1
dc.language.isoen
dc.pagina.final43
dc.pagina.inicio22
dc.revistaComputer music journal
dc.rightsacceso restringido
dc.titleA Fuzzy Gestural AI Approach for Expressive Interactivity in Multitouch Digital Musical Instruments Based on Laban Descriptors
dc.typeartículo
dc.volumen47
sipa.indexWOS
sipa.trazabilidadWOS;2025-01-12
Files
Collections
Artículos de revistas