research-article

Speculative Design with Generative AI: Applying Stable Diffusion and ChatGPT to imagining climate change futures

Authors:

Yuying TangAuthors Info & Claims

ARTECH '23: Proceedings of the 11th International Conference on Digital and Interactive Arts

Article No.: 36, Pages 1 - 8

https://doi.org/10.1145/3632776.3632827

Published: 03 April 2024 Publication History

Abstract

Policy mandates in addressing climate change are hindered by a lack of intrinsic motivation amongst participants to take collective action. Instead of overt persuasion, this study applied generative AI tools to speculative imagining of future climate scenarios and their adaptation strategies, using a workshop to encourage participants to align themselves with climate action. Participants used text-to-image tools to generate visions of the future in speculative scenarios, then prompted ChatGPT for potential solutions in these scenarios. They then asked text-to-image again to visualize the ChatGPT suggestions. Participants encountered difficulties editing or removing visual elements, dealt with the lack of transparency in the generation process by specifying the physical layout as opposed to the semantics, and collaboratively developed linguistic strategies for visual depiction of novel artifacts. This work shows how generative tools can be used to prototype future scenarios and envision designs that serve social purposes.

References

[1]

Annika Arnold. 2018. Climate Change and Storytelling: Narratives and Cultural Meaning in Environmental Communication. Springer.

[2]

Sofian Audry. 2021. Art in the Age of Machine Learning. MIT Press.

[3]

James Auger. 2013. Speculative design: crafting the speculation. Digit. Creat. 24, 1 (March 2013), 11–35.

[4]

Som S. Biswas. 2023. Potential Use of Chat GPT in Global Warming. Ann. Biomed. Eng. 51, 6 (June 2023), 1126–1127.

[5]

Yihan Cao, Siyu Li, Yixin Liu, Zhiling Yan, Yutong Dai, Philip S. Yu, and Lichao Sun. 2023. A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT.

[6]

Li-Yuan Chiou, Peng-Kai Hung, Rung-Huei Liang, and Chun-Teng Wang. 2023. Designing with AI: An Exploration of Co-Ideation with Image Generators. In Proceedings of the 2023 ACM Designing Interactive Systems Conference (DIS ’23), Association for Computing Machinery, New York, NY, USA, 1941–1954.

Digital Library

[7]

Paul Cohen. 2016. Harold Cohen and AARON. AI Mag. 37, 4 (2016), 63–66.

Digital Library

[8]

Michael D. Jones and Deserai Anderson Crow. 2017. How can we use the ‘science of stories’ to produce persuasive scientific stories? Palgrave Commun. 3, 1 (December 2017), 1–9.

[9]

Anthony Dunne. 2008. Hertzian Tales: Electronic Products, Aesthetic Experience, and Critical Design. MIT Press.

Digital Library

[10]

Anthony Dunne and Fiona Raby. 2013. Speculative Everything: Design, Fiction, and Social Dreaming. MIT Press.

Digital Library

[11]

Chris Elsden, David Chatting, Abigail C. Durrant, Andrew Garbett, Bettina Nissen, John Vines, and David S. Kirk. 2017. On Speculative Enactments. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17), Association for Computing Machinery, New York, NY, USA, 5386–5399.

Digital Library

[12]

Pedro Gil Farias, Roy Bendor, and Bregje F. van Eekelen. 2022. Social dreaming together: A critical exploration of participatory speculative design. In Proceedings of the Participatory Design Conference 2022 - Volume 2 (PDC ’22), Association for Computing Machinery, New York, NY, USA, 147–154.

Digital Library

[13]

Federico A. Galatolo, Mario G. C. A. Cimino, and Edoardo Cogotti. 2022. TeTIm-Eval: a novel curated evaluation data set for comparing text-to-image models.

[14]

Matthew K. Hong, Shabnam Hakimi, Yan-Ying Chen, Heishiro Toyoda, Charlene Wu, and Matt Klenk. 2023. Generative AI for Product Design: Getting the Right Design and the Design Right.

[15]

Youngseung Jeon, Seungwan Jin, Patrick C. Shih, and Kyungsik Han. 2021. FashionQ: An AI-Driven Creativity Support Tool for Facilitating Ideation in Fashion Design. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI ’21), Association for Computing Machinery, New York, NY, USA, 1–18.

Digital Library

[16]

Mirabelle Jones, Christina Neumayer, and Irina Shklovski. 2023. Embodying the Algorithm: Exploring Relationships with Large Language Models Through Artistic Performance. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), Association for Computing Machinery, New York, NY, USA, 1–24.

Digital Library

[17]

Christopher Kadow, David Matthew Hall, and Uwe Ulbrich. 2020. Artificial intelligence reconstructs missing climate information. Nat. Geosci. 13, 6 (June 2020), 408–413.

[18]

Kevin Gonyop Kim, Richard Lee Davis, Alessia Eletta Coppi, Alberto Cattaneo, and Pierre Dillenbourg. 2022. Mixplorer: Scaffolding Design Space Exploration through Genetic Recombination of Multiple Peoples’ Designs to Support Novices’ Creativity. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22), Association for Computing Machinery, New York, NY, USA, 1–13.

Digital Library

[19]

Janin Koch, Nicolas Taffin, Michel Beaudouin-Lafon, Markku Laine, Andrés Lucero, and Wendy E. Mackay. 2020. ImageSense: An Intelligent Collaborative Ideation Tool to Support Diverse Human-Computer Partnerships. Proc. ACM Hum.-Comput. Interact. 4, CSCW1 (May 2020), 45:1-45:27.

Digital Library

[20]

K. Kochanski, D. Rolnick, P. Donti, and L. Kaack. 2019. Climate change + AI: Tackling climate change with machine learning. 2019, (December 2019), GC33A-04.

[21]

Carole Larose, Christine Blaisot, and Eleanor Burke. 2022. A participatory student workshop on climate change and sustainability: a comparative case study. Sustain. Earth 5, 1 (October 2022), 3.

[22]

RAY LC. 2023. HUMAN ENOUGH: A Space for Reconstructions of AI visions in Speculative Climate Futures. In Proceedings of the 15th Conference on Creativity and Cognition (C&C ’23), Association for Computing Machinery, New York, NY, USA, 217–222.

Digital Library

[23]

Ray Lc. 2023. TOGETHER ENOUGH: Collaborative Constructions of Adaptations to Climate Futures. In Companion Publication of the 2023 ACM Designing Interactive Systems Conference (DIS ’23 Companion), Association for Computing Machinery, New York, NY, USA, 55–59.

Digital Library

[24]

RAY LC and Daijiro Mizuno. 2021. Designing for Narrative Influence: Speculative Storytelling for Social Good in Times of Public Health and Climate Crises. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (CHI EA ’21), Association for Computing Machinery, New York, NY, USA, 1–13.

Digital Library

[25]

RAY LC and Vincent Ruijters. 2022. CHIKYUCHI: In-person/remote game exhibition for climate change influence. In Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’22), Association for Computing Machinery, New York, NY, USA, 1–4.

Digital Library

[26]

Ray LC, Zijing Song, Yating Sun, and Cheng Yang. 2022. Designing narratives and data visuals in comic form for social influence in climate action. Front. Psychol. 13, (2022). Retrieved October 19, 2023 from https://www.frontiersin.org/articles/10.3389/fpsyg.2022.893181

[27]

Yu-Hsu Lee and Chun-Yao Chiu. 2023. The Impact of AI Text-to-Image Generator on Product Styling Design. In Human Interface and the Management of Information (Lecture Notes in Computer Science), Springer Nature Switzerland, Cham, 502–515.

Digital Library

[28]

Eleonora Mencarini, Christina Bremer, Chiara Leonardi, Jen Liu, Valentina Nisi, Nuno Jardim Nunes, and Robert Soden. 2023. HCI for Climate Change: Imagining Sustainable Futures. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA ’23), Association for Computing Machinery, New York, NY, USA, 1–6.

Digital Library

[29]

Piotr Mirowski, Kory W. Mathewson, Jaylen Pittman, and Richard Evans. 2023. Co-Writing Screenplays and Theatre Scripts with Language Models: Evaluation by Industry Professionals. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), Association for Computing Machinery, New York, NY, USA, 1–34.

Digital Library

[30]

Susanne C. Moser. 2016. Reflections on climate change communication research and practice in the second decade of the 21st century: what more is there to say? WIREs Clim. Change 7, 3 (2016), 345–369.

[31]

Michael Muller, Lydia B Chilton, Anna Kantosalo, Charles Patrick Martin, and Greg Walsh. 2022. GenAICHI: Generative AI and HCI. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (CHI EA ’22), Association for Computing Machinery, New York, NY, USA, 1–7.

Digital Library

[32]

Nassim Dehouche and Kullathida Dehouche. 2023. What is in a Text-to-Image Prompt: The Potential of Stable Diffusion in Visual Arts Education.

[33]

Saffron J. O'Neill, Maxwell Boykoff, Simon Niemeyer, and Sophie A. Day. 2013. On the use of imagery for climate change engagement. Glob. Environ. Change 23, 2 (April 2013), 413–421.

[34]

Anthony G. Patt and Elke U. Weber. 2014. Perceptions and communication strategies for the many uncertainties relevant for climate policy. WIREs Clim. Change 5, 2 (2014), 219–232.

[35]

Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever. 2021. Zero-Shot Text-to-Image Generation. In Proceedings of the 38th International Conference on Machine Learning, PMLR, 8821–8831. Retrieved June 23, 2023 from https://proceedings.mlr.press/v139/ramesh21a.html

[36]

Stuart Reeves. 2012. Envisioning ubiquitous computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’12), Association for Computing Machinery, New York, NY, USA, 1573–1582.

Digital Library

[37]

Othman Sbai, Mohamed Elhoseiny, Antoine Bordes, Yann LeCun, and Camille Couprie. 2018. DeSIGN: Design Inspiration from Generative Networks.

[38]

Zijing Song, Yating Sun, and Ray Lc. 2022. DRIZZLE: A Comic for Covert Climate Action Influence. In [ ] With Design: Reinventing Design Modes, Springer Nature, Singapore, 1613–1623.

[39]

Zijing Song, Yating Sun, Vincent Ruijters, and Ray Lc. 2021. Climate Influence: Implicit Game-Based Interactive Storytelling for Climate Action Purpose. In Interactive Storytelling (Lecture Notes in Computer Science), Springer International Publishing, Cham, 425–429.

Digital Library

[40]

Linda Steg. 2016. Values, Norms, and Intrinsic Motivation to Act Proenvironmentally. Annu. Rev. Environ. Resour. 41, 1 (2016), 277–292.

[41]

Yuqian Sun, Xuran Ni, Haozhen Feng, RAY LC, Chang Hee Lee, and Ali Asadipour. 2022. Bringing Stories to Life in 1001 Nights: A Co-creative Text Adventure Game Using a Story Generation Model. In Interactive Storytelling, Mirjam Vosmeer and Lissa Holloway-Attaway (eds.). Springer International Publishing, Cham, 651–672.

Digital Library

[42]

Yuqian Sun, Yuying Tang, Ze Gao, Zhijun Pan, Chuyan Xu, Yurou Chen, Kejiang Qian, Zhigang Wang, Tristan Braud, Chang Hee Lee, and Ali Asadipour. 2023. AI Nushu: An Exploration of Language Emergence in Sisterhood -Through the Lens of Computational Linguistics.

[43]

Yuqian Sun, Ying Xu, Chenhang Cheng, Yihua Li, Chang Hee Lee, and Ali Asadipour. 2023. Explore the Future Earth with Wander 2.0: AI Chatbot Driven By Knowledge-base Story Generation and Text-to-image Model. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA ’23), Association for Computing Machinery, New York, NY, USA, 1–5.

Digital Library

[44]

Mathias Peter Verheijden and Mathias Funk. 2023. Collaborative Diffusion: Boosting Designerly Co-Creation with Generative AI. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA ’23), Association for Computing Machinery, New York, NY, USA, 1–8.

Digital Library

[45]

Elke U. Weber. 2010. What shapes perceptions of climate change? WIREs Clim. Change 1, 3 (2010), 332–342.

[46]

Di Wu, Zhiwang Yu, Nan Ma, Jianan Jiang, Yuetian Wang, Guixiang Zhou, Hanhui Deng, and Yi Li. 2023. StyleMe: Towards Intelligent Fashion Generation with Designer Style. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), Association for Computing Machinery, New York, NY, USA, 1–16.

Digital Library

[47]

Zhuohao Wu, Danwen Ji, Kaiwen Yu, Xianxu Zeng, Dingming Wu, and Mohammad Shidujaman. 2021. AI Creativity and the Human-AI Co-creation Model. In Human-Computer Interaction. Theory, Methods and Tools (Lecture Notes in Computer Science), Springer International Publishing, Cham, 171–190.

Digital Library

[48]

J.D. Zamfirescu-Pereira, Richmond Y. Wong, Bjoern Hartmann, and Qian Yang. 2023. Why Johnny Can't Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, ACM, Hamburg Germany, 1–21.

Digital Library

[49]

Chenshuang Zhang, Chaoning Zhang, Mengchun Zhang, and In So Kweon. 2023. Text-to-image Diffusion Models in Generative AI: A Survey.

Cited By

Tang YZhang NCiancia MWang ZFarzan RLópez CCardoso Llach DQuercia DMustafa MNiu SWong-Villacrés M(2024)Exploring the Impact of AI-generated Image Tools on Professional and Non-professional Users in the Art and Design FieldsCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681890(451-458)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3678884.3681890
Zhou SHendra LLc R(2024)Eternagram: Post-Climate Devastation Text AdventureProceedings of the 17th International Symposium on Visual Information Communication and Interaction10.1145/3678698.3687201(1-2)Online publication date: 11-Dec-2024
https://dl.acm.org/doi/10.1145/3678698.3687201
LC R(2024)THE PRESENT IS IN THE FUTURE: Participatory Generative AI Co-Created Visions as Intangible Cultural HeritageProceedings of the 17th International Symposium on Visual Information Communication and Interaction10.1145/3678698.3687200(1-2)Online publication date: 11-Dec-2024
https://dl.acm.org/doi/10.1145/3678698.3687200
Show More Cited By

Index Terms

Speculative Design with Generative AI: Applying Stable Diffusion and ChatGPT to imagining climate change futures

Recommendations

Enhancing User Interaction in ChatGPT: Characterizing and Consolidating Multiple Prompts for Issue Resolution
MSR '24: Proceedings of the 21st International Conference on Mining Software Repositories

Prompt design plays a crucial role in shaping the efficacy of ChatGPT, influencing the model's ability to extract contextually accurate responses. Thus, optimal prompt construction is essential for maximizing the utility and performance of ChatGPT. ...
Persuasive System Design for Climate Change Awareness
Entertainment Computing – ICEC 2023
Abstract
We have been experiencing warmer years than before especially during the last decade, which has raised concerns among researchers of all discipline about climate change. In our attempt to raise awareness and promote positive behavior change to ...
Citizen involvement in the design of technology for climate change adaptation projects in the Pacific
OzCHI '14: Proceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: the Future of Design

This paper describes work in progress aimed at exploring a role for mobile technology in helping citizens adapt to climate change in the Pacific. The research involved codesign workshops and stakeholder interviews in Fiji. In this paper we describe the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ARTECH '23: Proceedings of the 11th International Conference on Digital and Interactive Arts

November 2023

335 pages

ISBN:9798400708725

DOI:10.1145/3632776

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 April 2024

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ARTECH 2023

ARTECH 2023: 11th International Conference on Digital and Interactive Arts

November 28 - 30, 2023

Faro, Portugal

Acceptance Rates

Overall Acceptance Rate 128 of 238 submissions, 54%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
320
Total Downloads

Downloads (Last 12 months)320
Downloads (Last 6 weeks)43

Reflects downloads up to 15 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tang YZhang NCiancia MWang ZFarzan RLópez CCardoso Llach DQuercia DMustafa MNiu SWong-Villacrés M(2024)Exploring the Impact of AI-generated Image Tools on Professional and Non-professional Users in the Art and Design FieldsCompanion Publication of the 2024 Conference on Computer-Supported Cooperative Work and Social Computing10.1145/3678884.3681890(451-458)Online publication date: 11-Nov-2024
https://dl.acm.org/doi/10.1145/3678884.3681890
Zhou SHendra LLc R(2024)Eternagram: Post-Climate Devastation Text AdventureProceedings of the 17th International Symposium on Visual Information Communication and Interaction10.1145/3678698.3687201(1-2)Online publication date: 11-Dec-2024
https://dl.acm.org/doi/10.1145/3678698.3687201
LC R(2024)THE PRESENT IS IN THE FUTURE: Participatory Generative AI Co-Created Visions as Intangible Cultural HeritageProceedings of the 17th International Symposium on Visual Information Communication and Interaction10.1145/3678698.3687200(1-2)Online publication date: 11-Dec-2024
https://dl.acm.org/doi/10.1145/3678698.3687200
Li MLi YHe CWang HZhong JJiang SHe MQiao ZChen JYin YLc RHan JYang ZShidujaman M(2024)Generative AI for Sustainable Design: A Case Study in Design Education PracticesHuman-Computer Interaction10.1007/978-3-031-60441-6_5(59-78)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60441-6_5

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents