RhizomeBridge: real-time communication between native audio plugins and Node.js via shared memory

video

informations

Type
Ensemble de conférences, symposium, congrès
Lieu de représentation
Ircam, Espace de projection (Paris)
date
20 novembre 2025

RhizomeBridge is a VST/AU plugin that enables real- time, bidirectional communication with minimal latency and sample-accurate precision between a Digital Audio Workstation (DAW) and an external Node.js process. Unlike protocol-based approaches that add overhead through serialisation, polling, or network delays, it establishes a di- rect connection between the native audio callback and the JavaScript environment via shared memory and semaphores.

Audio and MIDI are exchanged in raw binary format through native Node.js add-ons. A custom data organisation ensures temporal alignment and integrity even in asynchronous contexts.

Once in the JavaScript environment, data can be pro- cessed, routed back to the DAW, or forwarded to web applications, IoT devices, and collaborative platforms via pro- tocols such as WebRTC or WebSocket. This upper layer is decoupled from the critical DAW ↔ Node.js link, which remains deterministic and sample-accurate.

The system has been tested in scenarios including bidirectional local communication, real-time audio/MIDI processing in Node.js and browsers, and audiovisual performances on mobile and web platforms. Results are presented alongside a technical overview of the architecture and latency evaluation.

By bridging low-level audio infrastructure with high-level JavaScript environments, RhizomeBridge provides a modular and reusable architecture that connects web ecosystems with professional DAWs, supporting distributed collaboration and enabling hybrid practices in composition, interaction, and creative coding.


Web Audio Conference 2025 : jour 2

La WAC est une conférence internationale consacrée aux technologies et applications audio sur le web, accueillant des chercheurs, chercheuses, développeurs, développeuses et des artistes, pour discuter de la recherche universitaire et artistique, du développement, de la conception, de l'évaluation et des normes concernant les technologies web émergentes liées à l'audio. Pour ses 10 ans, thématisés « Hacking and Making with Web Audio », la WAC invite à explorer de nouvelles utilisations de l'API audio web.

intervenants

Les médias liés à cet évènement

There and Back Again: Composing for Networked Reverberation Chamber and Live Orchestra - Austin Franklin

20 novembre 2025

Vidéo

Can the Web Audio API Help Save Lives on the Road? - Roland Cahen, Victor Paredes

20 novembre 2025

Vidéo

Traces.js: A Javascript library for presenting music, physiology, and other time-series on the web - Lawrence Fyfe

20 novembre 2025

Vidéo

Listener, Musician, Composer: The Role of the User in Interactive Web-Based Sound Art - Eveline Vervliet

20 novembre 2025

Vidéo

Reflecting on research-creation methodologies in the development of distributed applications for live performance - Jean-Brice Godet, Benjamin Matuszewski

20 novembre 2025

Vidéo

Slow Coding for the Web: Memory, Testimony, and Time-Based Composition in Estuary - Jessica A. Rodriguez

20 novembre 2025

Vidéo

Using Web Audio API to determine audience member positions for immersive performances - Otto Rottier

20 novembre 2025

Vidéo

p5.spatial.js: Accessible Multichannel Sound Composition in the Browser - Thomas Martinez

This paper introduces p5.spatial.js, an open source JavaScript library for creating multichannel sound works in the web browser. Designed to extend the popular creative coding environment p5.js, p5.spatial.js adds multichan- nel audio outpu

20 novembre 2025

Vidéo

WebAssembly Music instrument plugin NFTs - Peter Salomonsen

20 novembre 2025

Vidéo

FLO + Reverbera!: Telematic City Jam - Paris

20 novembre 2025

Vidéo

MurMures

20 novembre 2025

Vidéo

Trialogues

20 novembre 2025

Vidéo

WCLAP: Reusing the CLAP standard for Web Audio - Geraint Luff

20 novembre 2025

Vidéo

The Periodic Table Arranged for Guitar and Sampler: A Real-Time Web MIDI Performance of the Periodic Table of elements

20 novembre 2025

Vidéo

Network latency fed back

20 novembre 2025

Vidéo

Orbits and Bodies

20 novembre 2025

Vidéo

Using Web Audio Plugins in 3D environments - Michel Buffa

This article explores the frontiers of interactive, modular music creation by presenting how existing WAM plugins, available on the Web in their 2D version, can be deployed in real-time 3D collaborative environments without any modification

20 novembre 2025

Vidéo

Multi-Version Song Exploration in Web VR Using A-Frame and Tone.js - Tom Collins

Music audio concepts and design for VR are relatively under-explored compared to visual analogs. This paper ad- dresses the design and evaluation of a dynamic experience of music in Web VR called VRTGO, in which a user explores three altern

20 novembre 2025

Vidéo

Introducing the MVP Support System: A Web-Based Intonation Feedback Tool for Wind Instrument Performance - Yasumasa Yamaguchi

20 novembre 2025

Vidéo

DawBi: A WebSocket-Based Plugin for Semantic Dialogue Between DAW and KOBI AI - Alberto Maria Gatti

Lately, the rise of AI generative systems has significantly influenced academic discourse on assisted composition, reshaping research agendas and scholarly practices. While generative tools can streamline exploratory workflows, they also au

20 novembre 2025

Vidéo

What Moves You?​ Hacking the Web with Counter-Choreography​ - Joana Chicau

This talk presents a practice-based research that uses choreography to critique the often-concealed algorithms operating in the background of everyday web environments. By harnessing choreographic practices, researchers can both reinforce e

20 novembre 2025

Vidéo

partager


Vous constatez une erreur ?

IRCAM

1, place Igor-Stravinsky
75004 Paris
+33 1 44 78 48 43

heures d'ouverture

Du lundi au vendredi de 9h30 à 19h
Fermé le samedi et le dimanche

accès en transports

Hôtel de Ville, Rambuteau, Châtelet, Les Halles

Institut de Recherche et de Coordination Acoustique/Musique

Copyright © 2022 Ircam. All rights reserved.