Methodological Considerations for Understanding Students’ Problem Solving Processes and Affective Trajectories During Game-Based Learning: A Data Fusion Approach

Maya Israel; Tongxi Liu; Jewoong Moon; Fengfeng Ke; Ibrahim Dahlstrom-Hakki

doi:10.1007/978-3-030-77414-1_15

Methodological Considerations for Understanding Students’ Problem Solving Processes and Affective Trajectories During Game-Based Learning: A Data Fusion Approach

Maya Israel^*, Tongxi Liu, Jewoong Moon, Fengfeng Ke, Ibrahim Dahlstrom-Hakki

^*Corresponding author for this work

Academy of Wellness and Human Development

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

1 Citation (Scopus)

Abstract

This paper describes methodological considerations for fusing data sources in understanding both affective and problem solving states of students as they engage in computational thinking (CT) game-based learning. We provide both a theoretical and empirical rationale for using data including facial recognition and students’ logfile data to gain a more robust explanation of why students may experience emotions such as frustration during CT game-based learning activities. We showcase illustrative examples using data from individual learners to highlight the methodological approaches that we have taken. Finally, given the complexities of understanding constructs such as affect and problem solving, we provide a rationale for using a data fusion methodological approach.

Original language	English
Title of host publication	HCI in Games
Subtitle of host publication	Serious and Immersive Games
Editors	Xiaowen Fang
Place of Publication	Cham
Publisher	Springer
Pages	201-215
Number of pages	15
Edition	1st
ISBN (Electronic)	9783030774141
ISBN (Print)	9783030774134
DOIs	https://doi.org/10.1007/978-3-030-77414-1_15
Publication status	Published - 24 Jul 2021
Event	3rd International Conference on HCI in Games held as part of the 23rd International Conference, HCI-Games/HCI International 2021 - Online Duration: 24 Jul 2021 → 29 Jul 2021 https://2021.hci.international/hci-games https://2021.hci.international/files/HCII2021_Final_Program.pdf https://link.springer.com/book/10.1007/978-3-030-77414-1

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	12790
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Name	Information Systems and Applications, incl. Internet/Web, and HCI
Publisher	Springer

Name	HCII: International Conference on Human-Computer Interaction Proceedings
Publisher	Springer
Volume	II

Conference

Conference	3rd International Conference on HCI in Games held as part of the 23rd International Conference, HCI-Games/HCI International 2021
City	Online
Period	24/07/21 → 29/07/21
Internet address	https://2021.hci.international/hci-games https://2021.hci.international/files/HCII2021_Final_Program.pdf https://link.springer.com/book/10.1007/978-3-030-77414-1

User-Defined Keywords

Data fusion
Facial expression
Game-based learning
Gameplay

Access to Document

10.1007/978-3-030-77414-1_15

Cite this

Israel, M., Liu, T., Moon, J., Ke, F., & Dahlstrom-Hakki, I. (2021). Methodological Considerations for Understanding Students’ Problem Solving Processes and Affective Trajectories During Game-Based Learning: A Data Fusion Approach. In X. Fang (Ed.), HCI in Games: Serious and Immersive Games (1st ed., pp. 201-215). (Lecture Notes in Computer Science; Vol. 12790), (Information Systems and Applications, incl. Internet/Web, and HCI), (HCII: International Conference on Human-Computer Interaction Proceedings; Vol. II). Springer. https://doi.org/10.1007/978-3-030-77414-1_15

Israel, Maya ; Liu, Tongxi ; Moon, Jewoong et al. / Methodological Considerations for Understanding Students’ Problem Solving Processes and Affective Trajectories During Game-Based Learning : A Data Fusion Approach. HCI in Games: Serious and Immersive Games. editor / Xiaowen Fang. 1st. ed. Cham : Springer, 2021. pp. 201-215 (Lecture Notes in Computer Science). (Information Systems and Applications, incl. Internet/Web, and HCI). (HCII: International Conference on Human-Computer Interaction Proceedings).

@inproceedings{9799c67025404c92b14fc82938f34174,

title = "Methodological Considerations for Understanding Students{\textquoteright} Problem Solving Processes and Affective Trajectories During Game-Based Learning: A Data Fusion Approach",

abstract = "This paper describes methodological considerations for fusing data sources in understanding both affective and problem solving states of students as they engage in computational thinking (CT) game-based learning. We provide both a theoretical and empirical rationale for using data including facial recognition and students{\textquoteright} logfile data to gain a more robust explanation of why students may experience emotions such as frustration during CT game-based learning activities. We showcase illustrative examples using data from individual learners to highlight the methodological approaches that we have taken. Finally, given the complexities of understanding constructs such as affect and problem solving, we provide a rationale for using a data fusion methodological approach.",

keywords = "Data fusion, Facial expression, Game-based learning, Gameplay",

author = "Maya Israel and Tongxi Liu and Jewoong Moon and Fengfeng Ke and Ibrahim Dahlstrom-Hakki",

note = "Publisher Copyright: {\textcopyright} Springer Nature Switzerland AG 2021.; 3rd International Conference on HCI in Games held as part of the 23rd International Conference, HCI-Games/HCI International 2021 ; Conference date: 24-07-2021 Through 29-07-2021",

year = "2021",

month = jul,

day = "24",

doi = "10.1007/978-3-030-77414-1_15",

language = "English",

isbn = "9783030774134",

series = "Lecture Notes in Computer Science",

publisher = "Springer",

pages = "201--215",

editor = "Xiaowen Fang",

booktitle = "HCI in Games",

edition = "1st",

url = "https://2021.hci.international/hci-games, https://2021.hci.international/files/HCII2021_Final_Program.pdf, https://link.springer.com/book/10.1007/978-3-030-77414-1",

}

Israel, M, Liu, T, Moon, J, Ke, F & Dahlstrom-Hakki, I 2021, Methodological Considerations for Understanding Students’ Problem Solving Processes and Affective Trajectories During Game-Based Learning: A Data Fusion Approach. in X Fang (ed.), HCI in Games: Serious and Immersive Games. 1st edn, Lecture Notes in Computer Science, vol. 12790, Information Systems and Applications, incl. Internet/Web, and HCI, HCII: International Conference on Human-Computer Interaction Proceedings, vol. II, Springer, Cham, pp. 201-215, 3rd International Conference on HCI in Games held as part of the 23rd International Conference, HCI-Games/HCI International 2021, Online, 24/07/21. https://doi.org/10.1007/978-3-030-77414-1_15

Methodological Considerations for Understanding Students’ Problem Solving Processes and Affective Trajectories During Game-Based Learning: A Data Fusion Approach. / Israel, Maya; Liu, Tongxi; Moon, Jewoong et al.
HCI in Games: Serious and Immersive Games. ed. / Xiaowen Fang. 1st. ed. Cham: Springer, 2021. p. 201-215 (Lecture Notes in Computer Science; Vol. 12790), (Information Systems and Applications, incl. Internet/Web, and HCI), (HCII: International Conference on Human-Computer Interaction Proceedings; Vol. II).

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

TY - GEN

T1 - Methodological Considerations for Understanding Students’ Problem Solving Processes and Affective Trajectories During Game-Based Learning

T2 - 3rd International Conference on HCI in Games held as part of the 23rd International Conference, HCI-Games/HCI International 2021

AU - Israel, Maya

AU - Liu, Tongxi

AU - Moon, Jewoong

AU - Ke, Fengfeng

AU - Dahlstrom-Hakki, Ibrahim

PY - 2021/7/24

Y1 - 2021/7/24

N2 - This paper describes methodological considerations for fusing data sources in understanding both affective and problem solving states of students as they engage in computational thinking (CT) game-based learning. We provide both a theoretical and empirical rationale for using data including facial recognition and students’ logfile data to gain a more robust explanation of why students may experience emotions such as frustration during CT game-based learning activities. We showcase illustrative examples using data from individual learners to highlight the methodological approaches that we have taken. Finally, given the complexities of understanding constructs such as affect and problem solving, we provide a rationale for using a data fusion methodological approach.

AB - This paper describes methodological considerations for fusing data sources in understanding both affective and problem solving states of students as they engage in computational thinking (CT) game-based learning. We provide both a theoretical and empirical rationale for using data including facial recognition and students’ logfile data to gain a more robust explanation of why students may experience emotions such as frustration during CT game-based learning activities. We showcase illustrative examples using data from individual learners to highlight the methodological approaches that we have taken. Finally, given the complexities of understanding constructs such as affect and problem solving, we provide a rationale for using a data fusion methodological approach.

KW - Data fusion

KW - Facial expression

KW - Game-based learning

KW - Gameplay

UR - http://www.scopus.com/inward/record.url?scp=85118706433&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-77414-1_15

DO - 10.1007/978-3-030-77414-1_15

M3 - Conference proceeding

AN - SCOPUS:85118706433

SN - 9783030774134

T3 - Lecture Notes in Computer Science

SP - 201

EP - 215

BT - HCI in Games

A2 - Fang, Xiaowen

PB - Springer

CY - Cham

Y2 - 24 July 2021 through 29 July 2021

ER -

Israel M, Liu T, Moon J, Ke F, Dahlstrom-Hakki I. Methodological Considerations for Understanding Students’ Problem Solving Processes and Affective Trajectories During Game-Based Learning: A Data Fusion Approach. In Fang X, editor, HCI in Games: Serious and Immersive Games. 1st ed. Cham: Springer. 2021. p. 201-215. (Lecture Notes in Computer Science). (Information Systems and Applications, incl. Internet/Web, and HCI). (HCII: International Conference on Human-Computer Interaction Proceedings). doi: 10.1007/978-3-030-77414-1_15

Methodological Considerations for Understanding Students’ Problem Solving Processes and Affective Trajectories During Game-Based Learning: A Data Fusion Approach

Abstract

Publication series

Conference

User-Defined Keywords

Access to Document

Other files and links

Fingerprint

Cite this