Enhancing Embodied Telepresence in First-Person View Drone Pilots through Real-Time Data-Driven Sound Design

Samuel Swope

doi:10.5204/book.eprints.256296

Enhancing Embodied Telepresence in First-Person View Drone Pilots through Real-Time Data-Driven Sound Design

Samuel Swope^*

^*Corresponding author for this work

Academy of Visual Arts

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

Abstract

This academic paper investigates the integration of real-time, data-driven sound design and construction within the context of first-person view (FPV) drone piloting. The objective of this study is to enhance the sense of embodied telepresence experienced by FPV drone pilots. The paper addresses several research gaps and questions, including the potential for shared experiences between the human body and the drone machine, the impact of different sound designs on the overall piloting experience, and the influence of new ocular and aural feedback on the pilot's understanding of aerodynamic position and movement. Additionally, the paper examines the limitations of current human-drone sensory overlay and emphasizes the necessity for a widely applicable methodology for aural sensory stimulation in drone operation. The research methodology encompasses the development of a physical prototype and the exploration of flight controller data sonification. The paper concludes with an evaluation of the prototype and the identification of areas that require further research and improvement, laying the foundation for integrating sound design into FPV drone control systems and opening up new possibilities for creating immersive and dynamic airborne art.

Original language	English
Title of host publication	Proceedings of the 29th International Symposium on Electronic Arts
Subtitle of host publication	ISEA2024 Everywhen Proceedings. Academic Papers
Editors	Gavin Sade, Andrew Brown, Leah Barclay, Jen Seevinck, Anastasia Tyurina, Rewa Wright
Publisher	Queensland University of Technology; ISEA International
Pages	706-712
Volume	1
ISBN (Electronic)	9781925553550
DOIs	https://doi.org/10.5204/book.eprints.256296
Publication status	Published - 21 Jun 2024
Event	29th International Symposium on Electronic Art, ISEA2024: Everywhen - Brisbane Convention Entertainment and Centre, Meanjin (Brisbane), Australia Duration: 21 Jun 2024 → 29 Jun 2024 https://isea2024.isea-international.org/welcome/ (Link to conference website) https://isea2024.isea-international.org/academic-program/ (Link to conference programme) https://eprints.qut.edu.au/256296/ (Conference proceedings)

Symposium

Symposium	29th International Symposium on Electronic Art, ISEA2024
Abbreviated title	ISEA
Country/Territory	Australia
City	Meanjin (Brisbane)
Period	21/06/24 → 29/06/24
Internet address	https://isea2024.isea-international.org/welcome/ (Link to conference website) https://isea2024.isea-international.org/academic-program/ (Link to conference programme) https://eprints.qut.edu.au/256296/ (Conference proceedings)

User-Defined Keywords

Art and technology
Embodied telepresence
First-person view
Drone/UAV
Sonification
Physical computing
Human-machine interaction
Human-drone interaction
Spatial awareness
Multisensorial interface
Flight controller

Access to Document

10.5204/book.eprints.256296Licence: CC BY-NC-ND

Cite this

Swope, S. (2024). Enhancing Embodied Telepresence in First-Person View Drone Pilots through Real-Time Data-Driven Sound Design. In G. Sade, A. Brown, L. Barclay, J. Seevinck, A. Tyurina, & R. Wright (Eds.), Proceedings of the 29th International Symposium on Electronic Arts: ISEA2024 Everywhen Proceedings. Academic Papers (Vol. 1, pp. 706-712). Queensland University of Technology; ISEA International. https://doi.org/10.5204/book.eprints.256296

Swope, Samuel. / Enhancing Embodied Telepresence in First-Person View Drone Pilots through Real-Time Data-Driven Sound Design. Proceedings of the 29th International Symposium on Electronic Arts: ISEA2024 Everywhen Proceedings. Academic Papers. editor / Gavin Sade ; Andrew Brown ; Leah Barclay ; Jen Seevinck ; Anastasia Tyurina ; Rewa Wright. Vol. 1 Queensland University of Technology; ISEA International, 2024. pp. 706-712

@inproceedings{cf18c56de51546e78e1da09fa5c92e04,

title = "Enhancing Embodied Telepresence in First-Person View Drone Pilots through Real-Time Data-Driven Sound Design",

abstract = "This academic paper investigates the integration of real-time, data-driven sound design and construction within the context of first-person view (FPV) drone piloting. The objective of this study is to enhance the sense of embodied telepresence experienced by FPV drone pilots. The paper addresses several research gaps and questions, including the potential for shared experiences between the human body and the drone machine, the impact of different sound designs on the overall piloting experience, and the influence of new ocular and aural feedback on the pilot's understanding of aerodynamic position and movement. Additionally, the paper examines the limitations of current human-drone sensory overlay and emphasizes the necessity for a widely applicable methodology for aural sensory stimulation in drone operation. The research methodology encompasses the development of a physical prototype and the exploration of flight controller data sonification. The paper concludes with an evaluation of the prototype and the identification of areas that require further research and improvement, laying the foundation for integrating sound design into FPV drone control systems and opening up new possibilities for creating immersive and dynamic airborne art.",

keywords = "Art and technology, Embodied telepresence, First-person view, Drone/UAV, Sonification, Physical computing, Human-machine interaction, Human-drone interaction, Spatial awareness, Multisensorial interface, Flight controller",

author = "Samuel Swope",

year = "2024",

month = jun,

day = "21",

doi = "10.5204/book.eprints.256296",

language = "English",

volume = "1",

pages = "706--712",

editor = "Sade, {Gavin } and Andrew Brown and Leah Barclay and Seevinck, {Jen } and Anastasia Tyurina and Rewa Wright",

booktitle = "Proceedings of the 29th International Symposium on Electronic Arts",

publisher = "Queensland University of Technology; ISEA International",

note = "29th International Symposium on Electronic Art, ISEA2024 : Everywhen, ISEA ; Conference date: 21-06-2024 Through 29-06-2024",

url = "https://isea2024.isea-international.org/welcome/, https://isea2024.isea-international.org/academic-program/, https://eprints.qut.edu.au/256296/",

}

Swope, S 2024, Enhancing Embodied Telepresence in First-Person View Drone Pilots through Real-Time Data-Driven Sound Design. in G Sade, A Brown, L Barclay, J Seevinck, A Tyurina & R Wright (eds), Proceedings of the 29th International Symposium on Electronic Arts: ISEA2024 Everywhen Proceedings. Academic Papers. vol. 1, Queensland University of Technology; ISEA International, pp. 706-712, 29th International Symposium on Electronic Art, ISEA2024, Meanjin (Brisbane), Queensland, Australia, 21/06/24. https://doi.org/10.5204/book.eprints.256296

Enhancing Embodied Telepresence in First-Person View Drone Pilots through Real-Time Data-Driven Sound Design. / Swope, Samuel.
Proceedings of the 29th International Symposium on Electronic Arts: ISEA2024 Everywhen Proceedings. Academic Papers. ed. / Gavin Sade; Andrew Brown; Leah Barclay; Jen Seevinck; Anastasia Tyurina; Rewa Wright. Vol. 1 Queensland University of Technology; ISEA International, 2024. p. 706-712.

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

TY - GEN

T1 - Enhancing Embodied Telepresence in First-Person View Drone Pilots through Real-Time Data-Driven Sound Design

AU - Swope, Samuel

PY - 2024/6/21

Y1 - 2024/6/21

N2 - This academic paper investigates the integration of real-time, data-driven sound design and construction within the context of first-person view (FPV) drone piloting. The objective of this study is to enhance the sense of embodied telepresence experienced by FPV drone pilots. The paper addresses several research gaps and questions, including the potential for shared experiences between the human body and the drone machine, the impact of different sound designs on the overall piloting experience, and the influence of new ocular and aural feedback on the pilot's understanding of aerodynamic position and movement. Additionally, the paper examines the limitations of current human-drone sensory overlay and emphasizes the necessity for a widely applicable methodology for aural sensory stimulation in drone operation. The research methodology encompasses the development of a physical prototype and the exploration of flight controller data sonification. The paper concludes with an evaluation of the prototype and the identification of areas that require further research and improvement, laying the foundation for integrating sound design into FPV drone control systems and opening up new possibilities for creating immersive and dynamic airborne art.

AB - This academic paper investigates the integration of real-time, data-driven sound design and construction within the context of first-person view (FPV) drone piloting. The objective of this study is to enhance the sense of embodied telepresence experienced by FPV drone pilots. The paper addresses several research gaps and questions, including the potential for shared experiences between the human body and the drone machine, the impact of different sound designs on the overall piloting experience, and the influence of new ocular and aural feedback on the pilot's understanding of aerodynamic position and movement. Additionally, the paper examines the limitations of current human-drone sensory overlay and emphasizes the necessity for a widely applicable methodology for aural sensory stimulation in drone operation. The research methodology encompasses the development of a physical prototype and the exploration of flight controller data sonification. The paper concludes with an evaluation of the prototype and the identification of areas that require further research and improvement, laying the foundation for integrating sound design into FPV drone control systems and opening up new possibilities for creating immersive and dynamic airborne art.

KW - Art and technology

KW - Embodied telepresence

KW - First-person view

KW - Drone/UAV

KW - Sonification

KW - Physical computing

KW - Human-machine interaction

KW - Human-drone interaction

KW - Spatial awareness

KW - Multisensorial interface

KW - Flight controller

U2 - 10.5204/book.eprints.256296

DO - 10.5204/book.eprints.256296

M3 - Conference proceeding

VL - 1

SP - 706

EP - 712

BT - Proceedings of the 29th International Symposium on Electronic Arts

A2 - Sade, Gavin

A2 - Brown, Andrew

A2 - Barclay, Leah

A2 - Seevinck, Jen

A2 - Tyurina, Anastasia

A2 - Wright, Rewa

PB - Queensland University of Technology; ISEA International

T2 - 29th International Symposium on Electronic Art, ISEA2024

Y2 - 21 June 2024 through 29 June 2024

ER -

Swope S. Enhancing Embodied Telepresence in First-Person View Drone Pilots through Real-Time Data-Driven Sound Design. In Sade G, Brown A, Barclay L, Seevinck J, Tyurina A, Wright R, editors, Proceedings of the 29th International Symposium on Electronic Arts: ISEA2024 Everywhen Proceedings. Academic Papers. Vol. 1. Queensland University of Technology; ISEA International. 2024. p. 706-712 doi: 10.5204/book.eprints.256296

Enhancing Embodied Telepresence in First-Person View Drone Pilots through Real-Time Data-Driven Sound Design

Abstract

Symposium

User-Defined Keywords

Access to Document

Fingerprint

Cite this