“Listen to Music, Listen to Yourself”: Design of a Conversational Agent to Support Self-Awareness While Listening to Music

Wanling Cai; Yucheng Jin; Xianglin Zhao; Li Chen

doi:10.1145/3544548.3581427

“Listen to Music, Listen to Yourself”: Design of a Conversational Agent to Support Self-Awareness While Listening to Music

Wanling Cai, Yucheng Jin, Xianglin Zhao, Li Chen

Department of Computer Science

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

7 Citations (Scopus)

Abstract

Music can affect the human brain and cognition. Melodies and lyrics that resonate with us can awaken our inner feelings and thoughts; being in touch with these feelings and expressing them allow us to understand ourselves better and increase our self-awareness. To support self-awareness elicited by music, we designed a novel conversational agent (CA) that guides users to become self-aware and express their thoughts when they listen to music. Moreover, we investigated two prominent design factors in the CA, proactive guidance and social information. We then conducted a 2x2 between-subjects experiment (N = 90) to investigate how the two design factors affect self-awareness, user acceptance, and mental well-being. The results of a five-day user study reveal that high proactive guidance and social information increased self-awareness, but high proactive guidance tended to influence perceived autonomy and usefulness negatively. Further, users’ subjective feedback revealed the CA’s potential to support mental well-being.

Original language	English
Title of host publication	CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Editors	Albrecht Schmidt, Kaisa Väänänen, Tesh Goyal, Per Ola Kristensson, Anicia Peters, Stefanie Mueller, Julie R. Williamson, Max L. Wilson
Publisher	Association for Computing Machinery (ACM)
Pages	1–19
Number of pages	19
ISBN (Electronic)	9781450394215
ISBN (Print)	9781450394215
DOIs	https://doi.org/10.1145/3544548.3581427
Publication status	Published - 19 Apr 2023
Event	2023 CHI Conference on Human Factors in Computing Systems, CHI 2023 - Hamburg, Germany Duration: 23 Apr 2023 → 28 Apr 2023 https://dl.acm.org/doi/proceedings/10.1145/3544548

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	2023 CHI Conference on Human Factors in Computing Systems, CHI 2023
Country/Territory	Germany
City	Hamburg
Period	23/04/23 → 28/04/23
Internet address	https://dl.acm.org/doi/proceedings/10.1145/3544548

Scopus Subject Areas

Software
Human-Computer Interaction
Computer Graphics and Computer-Aided Design

User-Defined Keywords

Listening to music
chatbot
emotional well-being
self-determination theory
user engagement

Access to Document

10.1145/3544548.3581427

Cite this

Cai, W., Jin, Y., Zhao, X., & Chen, L. (2023). “Listen to Music, Listen to Yourself”: Design of a Conversational Agent to Support Self-Awareness While Listening to Music. In A. Schmidt, K. Väänänen, T. Goyal, P. O. Kristensson, A. Peters, S. Mueller, J. R. Williamson, & M. L. Wilson (Eds.), CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (pp. 1–19). Article 119 (Conference on Human Factors in Computing Systems - Proceedings). Association for Computing Machinery (ACM). https://doi.org/10.1145/3544548.3581427

Cai, Wanling ; Jin, Yucheng ; Zhao, Xianglin et al. / “Listen to Music, Listen to Yourself”: Design of a Conversational Agent to Support Self-Awareness While Listening to Music. CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. editor / Albrecht Schmidt ; Kaisa Väänänen ; Tesh Goyal ; Per Ola Kristensson ; Anicia Peters ; Stefanie Mueller ; Julie R. Williamson ; Max L. Wilson. Association for Computing Machinery (ACM), 2023. pp. 1–19 (Conference on Human Factors in Computing Systems - Proceedings).

@inproceedings{0fd46550b13644c28abc7b8111884eb0,

title = "“Listen to Music, Listen to Yourself”: Design of a Conversational Agent to Support Self-Awareness While Listening to Music",

abstract = "Music can affect the human brain and cognition. Melodies and lyrics that resonate with us can awaken our inner feelings and thoughts; being in touch with these feelings and expressing them allow us to understand ourselves better and increase our self-awareness. To support self-awareness elicited by music, we designed a novel conversational agent (CA) that guides users to become self-aware and express their thoughts when they listen to music. Moreover, we investigated two prominent design factors in the CA, proactive guidance and social information. We then conducted a 2x2 between-subjects experiment (N = 90) to investigate how the two design factors affect self-awareness, user acceptance, and mental well-being. The results of a five-day user study reveal that high proactive guidance and social information increased self-awareness, but high proactive guidance tended to influence perceived autonomy and usefulness negatively. Further, users{\textquoteright} subjective feedback revealed the CA{\textquoteright}s potential to support mental well-being.",

keywords = "Listening to music, chatbot, emotional well-being, self-determination theory, user engagement",

author = "Wanling Cai and Yucheng Jin and Xianglin Zhao and Li Chen",

note = "Funding Information: This work was supported by Hong Kong Research Grants Council (RGC) GRF project (RGC/HKBU12201620), Hong Kong Baptist University IG-FNRA project (RC-FNRA-IG/21-22/SCI/01), and Hong Kong Baptist University Start-up Grant (RC-STARTUP/21-22/23). Publisher Copyright: {\textcopyright} 2023 ACM.; 2023 CHI Conference on Human Factors in Computing Systems, CHI 2023 ; Conference date: 23-04-2023 Through 28-04-2023",

year = "2023",

month = apr,

day = "19",

doi = "10.1145/3544548.3581427",

language = "English",

isbn = "9781450394215",

series = "Conference on Human Factors in Computing Systems - Proceedings",

publisher = "Association for Computing Machinery (ACM)",

pages = "1–19",

editor = "Albrecht Schmidt and Kaisa V{\"a}{\"a}n{\"a}nen and Tesh Goyal and Kristensson, {Per Ola} and Anicia Peters and Stefanie Mueller and Williamson, {Julie R.} and Wilson, {Max L.}",

booktitle = "CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems",

address = "United States",

url = "https://dl.acm.org/doi/proceedings/10.1145/3544548",

}

Cai, W, Jin, Y, Zhao, X & Chen, L 2023, “Listen to Music, Listen to Yourself”: Design of a Conversational Agent to Support Self-Awareness While Listening to Music. in A Schmidt, K Väänänen, T Goyal, PO Kristensson, A Peters, S Mueller, JR Williamson & ML Wilson (eds), CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems., 119, Conference on Human Factors in Computing Systems - Proceedings, Association for Computing Machinery (ACM), pp. 1–19, 2023 CHI Conference on Human Factors in Computing Systems, CHI 2023, Hamburg, Germany, 23/04/23. https://doi.org/10.1145/3544548.3581427

“Listen to Music, Listen to Yourself”: Design of a Conversational Agent to Support Self-Awareness While Listening to Music. / Cai, Wanling; Jin, Yucheng; Zhao, Xianglin et al.
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ed. / Albrecht Schmidt; Kaisa Väänänen; Tesh Goyal; Per Ola Kristensson; Anicia Peters; Stefanie Mueller; Julie R. Williamson; Max L. Wilson. Association for Computing Machinery (ACM), 2023. p. 1–19 119 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

TY - GEN

T1 - “Listen to Music, Listen to Yourself”: Design of a Conversational Agent to Support Self-Awareness While Listening to Music

AU - Cai, Wanling

AU - Jin, Yucheng

AU - Zhao, Xianglin

AU - Chen, Li

N1 - Funding Information: This work was supported by Hong Kong Research Grants Council (RGC) GRF project (RGC/HKBU12201620), Hong Kong Baptist University IG-FNRA project (RC-FNRA-IG/21-22/SCI/01), and Hong Kong Baptist University Start-up Grant (RC-STARTUP/21-22/23). Publisher Copyright: © 2023 ACM.

PY - 2023/4/19

Y1 - 2023/4/19

N2 - Music can affect the human brain and cognition. Melodies and lyrics that resonate with us can awaken our inner feelings and thoughts; being in touch with these feelings and expressing them allow us to understand ourselves better and increase our self-awareness. To support self-awareness elicited by music, we designed a novel conversational agent (CA) that guides users to become self-aware and express their thoughts when they listen to music. Moreover, we investigated two prominent design factors in the CA, proactive guidance and social information. We then conducted a 2x2 between-subjects experiment (N = 90) to investigate how the two design factors affect self-awareness, user acceptance, and mental well-being. The results of a five-day user study reveal that high proactive guidance and social information increased self-awareness, but high proactive guidance tended to influence perceived autonomy and usefulness negatively. Further, users’ subjective feedback revealed the CA’s potential to support mental well-being.

AB - Music can affect the human brain and cognition. Melodies and lyrics that resonate with us can awaken our inner feelings and thoughts; being in touch with these feelings and expressing them allow us to understand ourselves better and increase our self-awareness. To support self-awareness elicited by music, we designed a novel conversational agent (CA) that guides users to become self-aware and express their thoughts when they listen to music. Moreover, we investigated two prominent design factors in the CA, proactive guidance and social information. We then conducted a 2x2 between-subjects experiment (N = 90) to investigate how the two design factors affect self-awareness, user acceptance, and mental well-being. The results of a five-day user study reveal that high proactive guidance and social information increased self-awareness, but high proactive guidance tended to influence perceived autonomy and usefulness negatively. Further, users’ subjective feedback revealed the CA’s potential to support mental well-being.

KW - Listening to music

KW - chatbot

KW - emotional well-being

KW - self-determination theory

KW - user engagement

UR - http://www.scopus.com/inward/record.url?scp=85160013396&partnerID=8YFLogxK

U2 - 10.1145/3544548.3581427

DO - 10.1145/3544548.3581427

M3 - Conference proceeding

SN - 9781450394215

T3 - Conference on Human Factors in Computing Systems - Proceedings

SP - 1

EP - 19

BT - CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

A2 - Schmidt, Albrecht

A2 - Väänänen, Kaisa

A2 - Goyal, Tesh

A2 - Kristensson, Per Ola

A2 - Peters, Anicia

A2 - Mueller, Stefanie

A2 - Williamson, Julie R.

A2 - Wilson, Max L.

PB - Association for Computing Machinery (ACM)

T2 - 2023 CHI Conference on Human Factors in Computing Systems, CHI 2023

Y2 - 23 April 2023 through 28 April 2023

ER -

Cai W, Jin Y, Zhao X, Chen L. “Listen to Music, Listen to Yourself”: Design of a Conversational Agent to Support Self-Awareness While Listening to Music. In Schmidt A, Väänänen K, Goyal T, Kristensson PO, Peters A, Mueller S, Williamson JR, Wilson ML, editors, CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery (ACM). 2023. p. 1–19. 119. (Conference on Human Factors in Computing Systems - Proceedings). doi: 10.1145/3544548.3581427

“Listen to Music, Listen to Yourself”: Design of a Conversational Agent to Support Self-Awareness While Listening to Music

Abstract

Publication series

Conference

Scopus Subject Areas

User-Defined Keywords

Access to Document

Other files and links

Fingerprint

Cite this