MetaBow: Gesture Mapping in Immersive Sonic Environments

Davor Vince; Roberto Alonso Trillo; Peter Nelson

MetaBow: Gesture Mapping in Immersive Sonic Environments

Davor Vince^*, Roberto Alonso Trillo, Peter Nelson

^*Corresponding author for this work

Research output: Contribution to conference › Conference paper › peer-review

Abstract

This paper presents the MetaBow, an augmented violin bow designed to control digital sound processing through real-time motion tracking. We discuss the challenges of mapping Inertial Measurement Unit (IMU) data to audio parameters in immersive multi-speaker environments and propose hybrid strategies using both direct mapping and machine learning models. We reflect on design choices, trade-offs, and performer experience, drawing from technical development and performance contexts. Three condensed case studies illustrate the system’s versatility in spatial and interactive musical performance.

Original language	English
Publication status	Published - 24 Jun 2025
Event	New Interfaces for Musical Expression 2025 - The Australian National University, Canberra, Australia Duration: 24 Jun 2025 → 27 Jun 2025 https://nime2025.org/

Conference

Conference	New Interfaces for Musical Expression 2025
Abbreviated title	NIME 2025
Country/Territory	Australia
City	Canberra
Period	24/06/25 → 27/06/25
Internet address	https://nime2025.org/

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Cite this

@conference{37fdc32116c841459d0abc0227262c1e,

title = "MetaBow: Gesture Mapping in Immersive Sonic Environments",

abstract = "This paper presents the MetaBow, an augmented violin bow designed to control digital sound processing through real-time motion tracking. We discuss the challenges of mapping Inertial Measurement Unit (IMU) data to audio parameters in immersive multi-speaker environments and propose hybrid strategies using both direct mapping and machine learning models. We reflect on design choices, trade-offs, and performer experience, drawing from technical development and performance contexts. Three condensed case studies illustrate the system{\textquoteright}s versatility in spatial and interactive musical performance.",

author = "Davor Vince and {Alonso Trillo}, Roberto and Peter Nelson",

year = "2025",

month = jun,

day = "24",

language = "English",

note = "New Interfaces for Musical Expression 2025, NIME 2025 ; Conference date: 24-06-2025 Through 27-06-2025",

url = "https://nime2025.org/",

}

TY - CONF

T1 - MetaBow

T2 - New Interfaces for Musical Expression 2025

AU - Vince, Davor

AU - Alonso Trillo, Roberto

AU - Nelson, Peter

PY - 2025/6/24

Y1 - 2025/6/24

N2 - This paper presents the MetaBow, an augmented violin bow designed to control digital sound processing through real-time motion tracking. We discuss the challenges of mapping Inertial Measurement Unit (IMU) data to audio parameters in immersive multi-speaker environments and propose hybrid strategies using both direct mapping and machine learning models. We reflect on design choices, trade-offs, and performer experience, drawing from technical development and performance contexts. Three condensed case studies illustrate the system’s versatility in spatial and interactive musical performance.

AB - This paper presents the MetaBow, an augmented violin bow designed to control digital sound processing through real-time motion tracking. We discuss the challenges of mapping Inertial Measurement Unit (IMU) data to audio parameters in immersive multi-speaker environments and propose hybrid strategies using both direct mapping and machine learning models. We reflect on design choices, trade-offs, and performer experience, drawing from technical development and performance contexts. Three condensed case studies illustrate the system’s versatility in spatial and interactive musical performance.

UR - https://nime2025.org/proceedings/184.html

M3 - Conference paper

Y2 - 24 June 2025 through 27 June 2025

ER -

MetaBow: Gesture Mapping in Immersive Sonic Environments

Abstract

Conference

UN SDGs

Other files and links

Fingerprint

Cite this