Inner Voices: Reflexive Augmented Listening

Andreas Kratky; Juri Hwang

doi:10.1007/978-3-031-35634-6_17

Inner Voices: Reflexive Augmented Listening

Andreas Kratky^*, Juri Hwang

^*Corresponding author for this work

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

1 Citation (Scopus)

Abstract

This paper discusses the concept of reflexive augmented listening using three sound art projects realized by the authors as examples. Presenting a new take on the traditional soundwalk experience, two of the projects are location-specific and engage with historic events, and one of them employs machine learning to create an emergent form of location-specificity that adapts to the place where the audience is located. Facilitated by the custom-developed hardware platform of a combined sensor and transducer headset, the projects use a form of augmented reality that is focused on listening and the experience of sound and body movement in service of a reflexive engagement with historic events, space and sound. The paper discusses the conceptual, aesthetic and technological developments made in the realization of these projects. It contrasts the author’s approach with augmented reality experiences of current, predominantly visual, forms.

Original language	English
Title of host publication	Virtual, Augmented and Mixed Reality
Subtitle of host publication	15th International Conference, VAMR 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023, Proceedings
Editors	Jessie Y. C. Chen, Gino Fragomeni
Publisher	Springer Cham
Pages	233-252
Number of pages	20
ISBN (Electronic)	9783031356346
ISBN (Print)	9783031356339
DOIs	https://doi.org/10.1007/978-3-031-35634-6_17
Publication status	Published - 28 Jun 2023
Event	15th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2023, held as part of the 25th International Conference on Human-Computer Interaction, HCII 2023 - Copenhagen, Denmark Duration: 23 Jul 2023 → 28 Jul 2023 https://link.springer.com/book/10.1007/978-3-031-35634-6

Publication series

Name	Lecture Notes in Computer Science
Volume	14027
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Name	HCII: International Conference on Human-Computer Interaction

Conference

Conference	15th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2023, held as part of the 25th International Conference on Human-Computer Interaction, HCII 2023
Country/Territory	Denmark
City	Copenhagen
Period	23/07/23 → 28/07/23
Internet address	https://link.springer.com/book/10.1007/978-3-031-35634-6

User-Defined Keywords

Augmented Reality
Soundwalk
Wearables

Access to Document

10.1007/978-3-031-35634-6_17

Cite this

Kratky, A., & Hwang, J. (2023). Inner Voices: Reflexive Augmented Listening. In J. Y. C. Chen, & G. Fragomeni (Eds.), Virtual, Augmented and Mixed Reality: 15th International Conference, VAMR 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023, Proceedings (pp. 233-252). (Lecture Notes in Computer Science; Vol. 14027), (HCII: International Conference on Human-Computer Interaction). Springer Cham. https://doi.org/10.1007/978-3-031-35634-6_17

Kratky, Andreas ; Hwang, Juri. / Inner Voices : Reflexive Augmented Listening. Virtual, Augmented and Mixed Reality: 15th International Conference, VAMR 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023, Proceedings. editor / Jessie Y. C. Chen ; Gino Fragomeni. Springer Cham, 2023. pp. 233-252 (Lecture Notes in Computer Science). (HCII: International Conference on Human-Computer Interaction).

@inproceedings{8a93681e9659474989b9c6400283ca98,

title = "Inner Voices: Reflexive Augmented Listening",

abstract = "This paper discusses the concept of reflexive augmented listening using three sound art projects realized by the authors as examples. Presenting a new take on the traditional soundwalk experience, two of the projects are location-specific and engage with historic events, and one of them employs machine learning to create an emergent form of location-specificity that adapts to the place where the audience is located. Facilitated by the custom-developed hardware platform of a combined sensor and transducer headset, the projects use a form of augmented reality that is focused on listening and the experience of sound and body movement in service of a reflexive engagement with historic events, space and sound. The paper discusses the conceptual, aesthetic and technological developments made in the realization of these projects. It contrasts the author{\textquoteright}s approach with augmented reality experiences of current, predominantly visual, forms.",

keywords = "Augmented Reality, Soundwalk, Wearables",

author = "Andreas Kratky and Juri Hwang",

note = "Publisher Copyright: {\textcopyright} 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.; 15th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2023, held as part of the 25th International Conference on Human-Computer Interaction, HCII 2023 ; Conference date: 23-07-2023 Through 28-07-2023",

year = "2023",

month = jun,

day = "28",

doi = "10.1007/978-3-031-35634-6_17",

language = "English",

isbn = "9783031356339",

series = "Lecture Notes in Computer Science",

publisher = "Springer Cham",

pages = "233--252",

editor = "Chen, {Jessie Y. C.} and Gino Fragomeni",

booktitle = "Virtual, Augmented and Mixed Reality",

url = "https://link.springer.com/book/10.1007/978-3-031-35634-6",

}

Kratky, A & Hwang, J 2023, Inner Voices: Reflexive Augmented Listening. in JYC Chen & G Fragomeni (eds), Virtual, Augmented and Mixed Reality: 15th International Conference, VAMR 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023, Proceedings. Lecture Notes in Computer Science, vol. 14027, HCII: International Conference on Human-Computer Interaction, Springer Cham, pp. 233-252, 15th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2023, held as part of the 25th International Conference on Human-Computer Interaction, HCII 2023, Copenhagen, Denmark, 23/07/23. https://doi.org/10.1007/978-3-031-35634-6_17

Inner Voices: Reflexive Augmented Listening. / Kratky, Andreas ; Hwang, Juri.
Virtual, Augmented and Mixed Reality: 15th International Conference, VAMR 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023, Proceedings. ed. / Jessie Y. C. Chen; Gino Fragomeni. Springer Cham, 2023. p. 233-252 (Lecture Notes in Computer Science; Vol. 14027), (HCII: International Conference on Human-Computer Interaction).

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

TY - GEN

T1 - Inner Voices

T2 - 15th International Conference on Virtual, Augmented and Mixed Reality, VAMR 2023, held as part of the 25th International Conference on Human-Computer Interaction, HCII 2023

AU - Kratky, Andreas

AU - Hwang, Juri

PY - 2023/6/28

Y1 - 2023/6/28

N2 - This paper discusses the concept of reflexive augmented listening using three sound art projects realized by the authors as examples. Presenting a new take on the traditional soundwalk experience, two of the projects are location-specific and engage with historic events, and one of them employs machine learning to create an emergent form of location-specificity that adapts to the place where the audience is located. Facilitated by the custom-developed hardware platform of a combined sensor and transducer headset, the projects use a form of augmented reality that is focused on listening and the experience of sound and body movement in service of a reflexive engagement with historic events, space and sound. The paper discusses the conceptual, aesthetic and technological developments made in the realization of these projects. It contrasts the author’s approach with augmented reality experiences of current, predominantly visual, forms.

AB - This paper discusses the concept of reflexive augmented listening using three sound art projects realized by the authors as examples. Presenting a new take on the traditional soundwalk experience, two of the projects are location-specific and engage with historic events, and one of them employs machine learning to create an emergent form of location-specificity that adapts to the place where the audience is located. Facilitated by the custom-developed hardware platform of a combined sensor and transducer headset, the projects use a form of augmented reality that is focused on listening and the experience of sound and body movement in service of a reflexive engagement with historic events, space and sound. The paper discusses the conceptual, aesthetic and technological developments made in the realization of these projects. It contrasts the author’s approach with augmented reality experiences of current, predominantly visual, forms.

KW - Augmented Reality

KW - Soundwalk

KW - Wearables

UR - http://www.scopus.com/inward/record.url?scp=85171445303&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-35634-6_17

DO - 10.1007/978-3-031-35634-6_17

M3 - Conference proceeding

AN - SCOPUS:85171445303

SN - 9783031356339

T3 - Lecture Notes in Computer Science

SP - 233

EP - 252

BT - Virtual, Augmented and Mixed Reality

A2 - Chen, Jessie Y. C.

A2 - Fragomeni, Gino

PB - Springer Cham

Y2 - 23 July 2023 through 28 July 2023

ER -

Kratky A , Hwang J. Inner Voices: Reflexive Augmented Listening. In Chen JYC, Fragomeni G, editors, Virtual, Augmented and Mixed Reality: 15th International Conference, VAMR 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023, Proceedings. Springer Cham. 2023. p. 233-252. (Lecture Notes in Computer Science). (HCII: International Conference on Human-Computer Interaction). doi: 10.1007/978-3-031-35634-6_17

Inner Voices: Reflexive Augmented Listening

Abstract

Publication series

Conference

User-Defined Keywords

Access to Document

Other files and links

Fingerprint

Cite this