skip to main content
10.1145/3680530.3695446acmconferencesArticle/Chapter ViewAbstractPublication Pagessiggraph-asiaConference Proceedingsconference-collections
research-article

I Light U Up: Exploring a New Emergent Narrative Paradigm through Physical Data Participation in AI Generative Experiences

Published: 19 November 2024 Publication History

Abstract

This paper introduces "I Light U Up", an interactive installation that explores the use of light as input for emergent narrative powered by LLM. Through an installation with light sensors, the audience uses light to communicate with the parallel digital beings, generating a narrative experience that emerges from the interaction. This work serves as a proof-of-concept, supporting a conceptual framework that aims to open new perspectives on the participation of physical data in emergent narrative experiences. It seeks to develop a new dimension in contrast to the text-centric one-way relationship between reader and story by including agency beyond human interactivity.

Supplemental Material

MP4 File
Video Demonstration

References

[1]
Hume AI. 2024. Hume AI: Building Empathetic AI Systems. https://www.hume.ai/ Accessed: 2024-06-29.
[2]
Ruth Aylett. 1999. Narrative in virtual environments-towards emergent narrative. In Proceedings of the AAAI fall symposium on narrative intelligence. USA, 83–86.
[3]
Purav Bhardwaj and Misha Sra. 2023. Ghost in the Machine: Discourses with AI. In SIGGRAPH Asia 2023 Art Papers (Sydney, NSW, Australia) (SA ’23). Association for Computing Machinery, New York, NY, USA, Article 6, 6 pages.
[4]
Shira Chess. 2014. Augmented regionalism: Ingress as geomediated gaming narrative. Information, Communication & Society 17, 9 (2014), 1105–1117.
[5]
Michele Geronazzo and Stefania Serafin (Eds.). 2023. Sonic Interactions in Virtual Environments. Springer Nature. Accepted: 2022-11-18T14:20:06Z.
[6]
Craig Paul Green. 2020. Finite State Machines and Live Emergent Narrative Theatre. In AI4Narratives@IJCAI. https://api.semanticscholar.org/CorpusID:231886303
[7]
Daniel Harley, Jean Ho Chu, Jamie Kwan, and Ali Mazalek. 2016. Towards a framework for tangible narratives. In Proceedings of the TEI’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction. 62–69.
[8]
Hartmut Koenitz, Gabriele Ferri, Mads Haahr, Diğdem Sezen, and Tonguç İbrahim Sezen. 2015. Interactive digital narrative. History, Theory and Practice (2015).
[9]
Ludeon Studios. 2018. RimWorld. Digital game available at Steam Store. https://store.steampowered.com/app/294100/RimWorld/
[10]
Michael Mateas and Andrew Stern. 2005. Façade. (2005).
[11]
Ali Mazalek, Claudia Winegarden, Tristan Al-Haddad, Susan J Robinson, and Chih-Sung Wu. 2009. Architales: physical/digital co-design of an interactive story table. In Proceedings of the 3rd International Conference on Tangible and Embedded Interaction. 241–248.
[13]
Takafumi Morita and Yasuaki Kakehi. 2023. see-saw: A Kinetic Installation that Unfolds in Silence Driven by Liquid Flow. In SIGGRAPH Asia 2023 Art Papers (Sydney, NSW, Australia) (SA ’23). Association for Computing Machinery, New York, NY, USA, Article 10, 6 pages.
[14]
OpenAI. 2024a. ChatGPT. https://chatgpt.com/ Accessed: 2024-06-21.
[15]
OpenAI. 2024b. Hello, GPT-4o. https://openai.com/index/hello-gpt-4o/ Accessed: 2024-06-29.
[18]
Uwe Rieger, Yinan Liu, Tharindu Kaluarachchi, Amit Barde, Huidong Bai, Alaeddin Nassani, Suranga Nanayakkara, and Mark Billinghurst. 2023. LightSense - Long Distance. In SIGGRAPH Asia 2023 Art Gallery (Sydney, NSW, Australia) (SA ’23). Association for Computing Machinery, New York, NY, USA, Article 13, 2 pages.
[20]
James A Russell. 1980. A circumplex model of affect.Journal of personality and social psychology 39, 6 (1980), 1161.
[21]
Marie-Laure Ryan. 2009. From Narrative Games to Playable Stories: Toward a Poetics of Interactive Narrative. Storyworlds: A Journal of Narrative Studies 1 (2009), 43–59. http://www.jstor.org/stable/25663007
[22]
Jennifer Seevinck. 2017. Emergence in interactive art. Springer.
[23]
Yang Ting Shen and Ali Mazalek. 2010. PuzzleTale: A Tangible Puzzle Game for Interactive Storytelling. ACM Computers in Entertainment (CIE) 8, 2 (2010), 11.
[24]
Yuqian Sun, Zhouyi Li, Ke Fang, Chang Hee Lee, and Ali Asadipour. 2023a. Language as reality: a co-creative storytelling game experience in 1001 nights using generative AI. In Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Vol. 19. 425–434.
[25]
Yuqian Sun, Yuying Tang, Ze Gao, Zhijun Pan, Chuyan Xu, Yurou Chen, Kejiang Qian, Zhigang Wang, Tristan Braud, Chang Hee Lee, and Ali Asadipour. 2023b. AI Nüshu: An Exploration of Language Emergence in Sisterhood Through the Lens of Computational Linguistics. In SIGGRAPH Asia 2023 Art Papers (Sydney, NSW, Australia) (SA ’23). Association for Computing Machinery, New York, NY, USA, Article 4, 7 pages.
[26]
Dave Szulborski. 2005. This is not a game: A guide to alternate reality gaming. Incunabula.
[27]
Richard Walsh. 2011. Emergent narrative in interactive media. Narrative 19, 1 (2011), 72–85.
[28]
Hao Wang and Chuen-Tsai Sun. 2011. Game reward systems: Gaming experiences and social meanings. In Proceedings of DiGRA 2011 Conference: Think Design Play.
[29]
Daniel White. 2021. “A Magic Beyond All We Do Here”: Musical and Sonic Worldbuilding at Harry Potter Tourist Attractions. InMedia. The French Journal of Media Studies9.1. (Jan. 2021). Number: 9.1. Publisher: Institut du monde anglophone.
[30]
Andrew Yip. 2023. The Garden of Unearthly Delights. In SIGGRAPH Asia 2023 Art Gallery (Sydney, NSW, Australia) (SA ’23). Association for Computing Machinery, New York, NY, USA, Article 21, 2 pages.

Index Terms

  1. I Light U Up: Exploring a New Emergent Narrative Paradigm through Physical Data Participation in AI Generative Experiences

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        SA '24: SIGGRAPH Asia 2024 Art Papers
        December 2024
        194 pages
        ISBN:9798400711336
        DOI:10.1145/3680530
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 19 November 2024

        Check for updates

        Author Tags

        1. Emergent Narrative
        2. Large-Language-Model(LLM)
        3. Emergent Art

        Qualifiers

        • Research-article

        Conference

        SA '24
        Sponsor:
        SA '24: SIGGRAPH Asia 2024 Art Papers
        December 3 - 6, 2024
        Tokyo, Japan

        Acceptance Rates

        Overall Acceptance Rate 178 of 869 submissions, 20%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 369
          Total Downloads
        • Downloads (Last 12 months)369
        • Downloads (Last 6 weeks)138
        Reflects downloads up to 20 Jan 2025

        Other Metrics

        Citations

        View Options

        Login options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Full Text

        View this article in Full Text.

        Full Text

        HTML Format

        View this article in HTML Format.

        HTML Format

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media