Scripted Spaces - An Approach to Generative AI for 3D Spaces

Andreas Kratky; Michael Overton Brown; Samantha Chuang; Quinn Liu

doi:10.1007/978-3-031-94168-9_9

Scripted Spaces - An Approach to Generative AI for 3D Spaces

Andreas Kratky^*, Michael Overton Brown, Samantha Chuang, Quinn Liu

^*Corresponding author for this work

Academy of Visual Arts

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

Abstract

Generative AI has found its way into creative production in a variety of ways. The creation of spatial structures, though, has been largely absent from AI-based generation processes. The main reason for this absence is the lack of training data sets with pairs of 3d-structures and descriptive text. With this project we are exploring possible approaches of generating such pairs. Film scripts and their corresponding film images represent a rich resource for spatial structures and their descriptions. We are investigating methods to leverage this resource by identifying descriptive passages and correlating them with 3-dimensional reconstructions of the corresponding spatial structures.

Original language	English
Title of host publication	HCI International 2025 Posters
Subtitle of host publication	27th International Conference on Human-Computer Interaction, HCII 2025, Gothenburg, Sweden, June 22–27, 2025, Proceedings, Part VII
Editors	Constantine Stephanidis, Margherita Antona, Stavroula Ntoa, Gavriel Salvendy
Publisher	Springer Cham
Pages	89-98
Number of pages	10
Edition	1st
ISBN (Electronic)	9783031941689
ISBN (Print)	9783031941672
DOIs	https://doi.org/10.1007/978-3-031-94168-9_9
Publication status	Published - 6 Jun 2025
Event	27th International Conference on Human-Computer Interaction, HCII 2025 - Gothenburg, Sweden Duration: 22 Jun 2025 → 27 Jun 2025

Publication series

Name	Communications in Computer and Information Science
Volume	2528
ISSN (Print)	1865-0929
ISSN (Electronic)	1865-0937

Name	HCII: International Conference on Human-Computer Interaction

Conference

Conference	27th International Conference on Human-Computer Interaction, HCII 2025
Country/Territory	Sweden
City	Gothenburg
Period	22/06/25 → 27/06/25

User-Defined Keywords

Gaussian Splatting
Generative AI
Movies
Spatial Representation
Training Data

Access to Document

10.1007/978-3-031-94168-9_9

Cite this

Kratky, A., Brown, M. O., Chuang, S., & Liu, Q. (2025). Scripted Spaces - An Approach to Generative AI for 3D Spaces. In C. Stephanidis, M. Antona, S. Ntoa, & G. Salvendy (Eds.), HCI International 2025 Posters: 27th International Conference on Human-Computer Interaction, HCII 2025, Gothenburg, Sweden, June 22–27, 2025, Proceedings, Part VII (1st ed., pp. 89-98). (Communications in Computer and Information Science; Vol. 2528), (HCII: International Conference on Human-Computer Interaction). Springer Cham. https://doi.org/10.1007/978-3-031-94168-9_9

Kratky, Andreas ; Brown, Michael Overton ; Chuang, Samantha et al. / Scripted Spaces - An Approach to Generative AI for 3D Spaces. HCI International 2025 Posters: 27th International Conference on Human-Computer Interaction, HCII 2025, Gothenburg, Sweden, June 22–27, 2025, Proceedings, Part VII. editor / Constantine Stephanidis ; Margherita Antona ; Stavroula Ntoa ; Gavriel Salvendy. 1st. ed. Springer Cham, 2025. pp. 89-98 (Communications in Computer and Information Science). (HCII: International Conference on Human-Computer Interaction).

@inproceedings{aeb8d2dd719949e5adc0b00f1bdc73d5,

title = "Scripted Spaces - An Approach to Generative AI for 3D Spaces",

abstract = "Generative AI has found its way into creative production in a variety of ways. The creation of spatial structures, though, has been largely absent from AI-based generation processes. The main reason for this absence is the lack of training data sets with pairs of 3d-structures and descriptive text. With this project we are exploring possible approaches of generating such pairs. Film scripts and their corresponding film images represent a rich resource for spatial structures and their descriptions. We are investigating methods to leverage this resource by identifying descriptive passages and correlating them with 3-dimensional reconstructions of the corresponding spatial structures.",

keywords = "Gaussian Splatting, Generative AI, Movies, Spatial Representation, Training Data",

author = "Andreas Kratky and Brown, {Michael Overton} and Samantha Chuang and Quinn Liu",

note = "This project was funded by the AIMS Award of the University of Southern California Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.; 27th International Conference on Human-Computer Interaction, HCII 2025 ; Conference date: 22-06-2025 Through 27-06-2025",

year = "2025",

month = jun,

day = "6",

doi = "10.1007/978-3-031-94168-9_9",

language = "English",

isbn = "9783031941672",

series = "Communications in Computer and Information Science",

publisher = "Springer Cham",

pages = "89--98",

editor = "Constantine Stephanidis and Margherita Antona and Stavroula Ntoa and Gavriel Salvendy",

booktitle = "HCI International 2025 Posters",

edition = "1st",

}

Kratky, A, Brown, MO, Chuang, S & Liu, Q 2025, Scripted Spaces - An Approach to Generative AI for 3D Spaces. in C Stephanidis, M Antona, S Ntoa & G Salvendy (eds), HCI International 2025 Posters: 27th International Conference on Human-Computer Interaction, HCII 2025, Gothenburg, Sweden, June 22–27, 2025, Proceedings, Part VII. 1st edn, Communications in Computer and Information Science, vol. 2528, HCII: International Conference on Human-Computer Interaction, Springer Cham, pp. 89-98, 27th International Conference on Human-Computer Interaction, HCII 2025, Gothenburg, Sweden, 22/06/25. https://doi.org/10.1007/978-3-031-94168-9_9

Scripted Spaces - An Approach to Generative AI for 3D Spaces. / Kratky, Andreas; Brown, Michael Overton; Chuang, Samantha et al.
HCI International 2025 Posters: 27th International Conference on Human-Computer Interaction, HCII 2025, Gothenburg, Sweden, June 22–27, 2025, Proceedings, Part VII. ed. / Constantine Stephanidis; Margherita Antona; Stavroula Ntoa; Gavriel Salvendy. 1st. ed. Springer Cham, 2025. p. 89-98 (Communications in Computer and Information Science; Vol. 2528), (HCII: International Conference on Human-Computer Interaction).

Research output: Chapter in book/report/conference proceeding › Conference proceeding › peer-review

TY - GEN

T1 - Scripted Spaces - An Approach to Generative AI for 3D Spaces

AU - Kratky, Andreas

AU - Brown, Michael Overton

AU - Chuang, Samantha

AU - Liu, Quinn

N1 - This project was funded by the AIMS Award of the University of Southern California Publisher Copyright: © The Author(s), under exclusive license to Springer Nature Switzerland AG 2025.

PY - 2025/6/6

Y1 - 2025/6/6

N2 - Generative AI has found its way into creative production in a variety of ways. The creation of spatial structures, though, has been largely absent from AI-based generation processes. The main reason for this absence is the lack of training data sets with pairs of 3d-structures and descriptive text. With this project we are exploring possible approaches of generating such pairs. Film scripts and their corresponding film images represent a rich resource for spatial structures and their descriptions. We are investigating methods to leverage this resource by identifying descriptive passages and correlating them with 3-dimensional reconstructions of the corresponding spatial structures.

AB - Generative AI has found its way into creative production in a variety of ways. The creation of spatial structures, though, has been largely absent from AI-based generation processes. The main reason for this absence is the lack of training data sets with pairs of 3d-structures and descriptive text. With this project we are exploring possible approaches of generating such pairs. Film scripts and their corresponding film images represent a rich resource for spatial structures and their descriptions. We are investigating methods to leverage this resource by identifying descriptive passages and correlating them with 3-dimensional reconstructions of the corresponding spatial structures.

KW - Gaussian Splatting

KW - Generative AI

KW - Movies

KW - Spatial Representation

KW - Training Data

UR - http://www.scopus.com/inward/record.url?scp=105008676924&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-94168-9_9

DO - 10.1007/978-3-031-94168-9_9

M3 - Conference proceeding

SN - 9783031941672

T3 - Communications in Computer and Information Science

SP - 89

EP - 98

BT - HCI International 2025 Posters

A2 - Stephanidis, Constantine

A2 - Antona, Margherita

A2 - Ntoa, Stavroula

A2 - Salvendy, Gavriel

PB - Springer Cham

T2 - 27th International Conference on Human-Computer Interaction, HCII 2025

Y2 - 22 June 2025 through 27 June 2025

ER -

Kratky A, Brown MO, Chuang S, Liu Q. Scripted Spaces - An Approach to Generative AI for 3D Spaces. In Stephanidis C, Antona M, Ntoa S, Salvendy G, editors, HCI International 2025 Posters: 27th International Conference on Human-Computer Interaction, HCII 2025, Gothenburg, Sweden, June 22–27, 2025, Proceedings, Part VII. 1st ed. Springer Cham. 2025. p. 89-98. (Communications in Computer and Information Science). (HCII: International Conference on Human-Computer Interaction). doi: 10.1007/978-3-031-94168-9_9