Investigating the shared neural processing of music and speech with data-driven modeling of brain data

0:00/0:00

From the same archive

Mettre en temps une structure musicale : l'activité de composition de Voi(rex) par Philippe Leroux - Nicolas Donin, Jacques Theureau

undefined 01 h 01 min

Mettre en temps une structure musicale : l'activité de composition de Voi(rex) par Philippe Leroux - Nicolas Donin, Jacques Theureau

undefined 24 min

L'estimation de fréquences fondamentales multiples

undefined 52 min

La harpe électroacoustique

undefined 01 h 18 min

Utilisation de Modalys pour le projet VoxStruments, lutherie numérique intuitive et expressive - Nicholas Ellis, Joël Bensoam

undefined 49 min

Présentation des travaux l'équipe PdS dans le cadre du projet européen CLOSED : "Closing the Loop of Sound Evaluation and Design" - Olivier Houix

undefined 01 h 12 min

Sparse overcomplete methods, matching pursuit and basis pursuit - Bob L. Sturm

undefined 48 min

Transformations de type et de nature de la voix - Snorre Farner, Axel Roebel, Xavier Rodet

undefined 01 h 07 min

Segmentations et reconnaissances automatiques de phonèmes de la voix, temps différé, temps réel - Pierre Lanchantin, Julien Bloit, Xavier Rodet

undefined 01 h 13 min

Synthèse de la parole à partir du texte et construction d'une base de données d'unités de la voix - Christophe Veaux, Grégory Beller, Xavier Rodet

undefined 01 h 00 min

Projet ECOUTE - Jerome Barthelemy, Nicolas Donin, Geoffroy Peeters, Samuel Goldszmidt

undefined 01 h 12 min

Projet MusicDiscover - David Fenech Saint Genieys

undefined 01 h 10 min

Projet CASPAR - Jerome Barthelemy, Alain Bonardi

undefined 50 min

Projet CONSONNES 1ère partie - René Caussé, Vincent Freour, David Roze

undefined 57 min

In this presentation, I give an overview of my work on music perception, with a particular focus on how the brain processes music compared to speech in naturalistic scenarios. I discuss how data-driven modeling can be used in this context to link continuous, complex sounds to multivariate neural activity, complementing more traditional paradigms that rely on discrete, controlled stimuli. Such modelling allows to probe underlying cog-neural processes that are otherwise hard to access as they operate on the natural unfolding of musical and linguistic structures over time (e.g., predictive mechanisms) and are modulated by complex internal states (e.g., attention). Thanks to this framework, we could probe signatures of shared and distinct neural processing of music and speech, as well as how factors such as attention, structure, and context shape their representations in the brain.

__

Giorgia Cantisani is a CNRS researcher working at the intersection of auditory neuroscience and machine learning. She earned her PhD at Télécom Paris, where she worked on brain data decoding for music-related BCIs. Since then, she has been working at École Normale Supérieure and now at IRCAM, investigating how the brain processes complex sounds such as music and speech and how the two interact in song.

speakers

information

Type
Séminaire / Conférence
performance location
Ircam, Salle Igor-Stravinsky (Paris)

IRCAM

1, place Igor-Stravinsky
75004 Paris
+33 1 44 78 48 43

opening times

Monday through Friday 9:30am-7pm
Closed Saturday and Sunday

subway access

Hôtel de Ville, Rambuteau, Châtelet, Les Halles

Institut de Recherche et de Coordination Acoustique/Musique

Copyright © 2022 Ircam. All rights reserved.