other

IRIDiuM+: deep media storytelling with non-linear light field video

Authors:

Kenny MitchellAuthors Info & Claims

SIGGRAPH '17: ACM SIGGRAPH 2017 VR Village

Article No.: 10, Pages 1 - 2

https://doi.org/10.1145/3089269.3089277

Published: 30 July 2017 Publication History

Get Access

Abstract

We present immersive storytelling in VR enhanced with non-linear sequenced sound, touch and light. Our Deep Media [Rose 2012] aim is to allow for guests to physically enter rendered movies with novel non-linear storytelling capability. With the ability to change the outcome of the story through touch and physical movement, we enable the agency of guests to make choices with consequences in immersive movies. We extend, IRIDiuM [Koniaris et al. 2016, 2017] to allow branching streams of full-motion light field video depending on user actions in real time. The interactive narrative guides guests through the immersive story with lighting and spatial audio design and integrates both walkable and air haptic actuators.

References

[1]

Sharon Calahan. 1996. Pixel Cinematography: Storytelling through Lighting: A Computer Graphics Perspective. In ACM SIGGRAPH 1996 Course 30. ACM.

Google Scholar

[2]

Andy Clarke and Grethe Mitchell. 2001. Film and the Development of Interactive Narrative. In Proceedings of the International Conference on Virtual Storytelling: Using Virtual Reality Technologies for Storytelling (ICVS '01). Springer-Verlag, London, UK, UK, 81--89. http://dl.acm.org/citation.cfm?id=646956.713628

Digital Library

Google Scholar

[3]

Lawrence Hettinger and Gary Riccio. 1992. Visually induced motion sickness in virtual environments. Presence: Teleoperators & Virtual Environments 1, 3 (1992).

Google Scholar

[4]

Babis Koniaris, Ivan Huerta, Maggie Kosek, Karen Darragh, Charles Malleson, Joanna Jamrozy, Nick Swafford, Jose Guitian, Bochang Moon, Ali Israr, and Kenny Mitchell. 2016. IRIDiuM: Immersive Rendered Interactive Deep Media. In ACM SIGGRAPH 2016 VR Village (SIGGRAPH '16). ACM, New York, NY, USA, Article 11, 2 pages.

Digital Library

Google Scholar

[5]

Babis Koniaris, Maggie Kosek, David Sinclair, and Kenny Mitchell. 2017. Real-time Rendering with Compressed Animated Light Fields. In Proceedings of Graphics Interface. Canadian Information Processing Society.

Google Scholar

[6]

David Murphy and Ian Pitt. 2001. Spatial sound enhancing virtual story telling. In International Conference on Virtual Storytelling. Springer, 20--29.

Digital Library

Google Scholar

[7]

Frank Rose. 2012. The Art of Immersion: How the Digital Generation is Remaking Hollywood, Madison Avenue, and the Way We Tell Stories. WW Norton & Co.

Google Scholar

Cited By

View all

Zinovieva T(2024)Video Games As Deep Media: Challenges During The Russian-Ukrainian WarObraz10.21272/Obraz.2024.1(44)-45-5744:1(45-57)Online publication date: 2024
https://doi.org/10.21272/Obraz.2024.1(44)-45-57
Kroma AMaiden NSas C(2022)The Technical Dilemmas of Creative Design and Rapid Prototyping for Immersive StorytellingProceedings of the 14th Conference on Creativity and Cognition10.1145/3527927.3533730(698-703)Online publication date: 20-Jun-2022
https://dl.acm.org/doi/10.1145/3527927.3533730
Rothe SBuschek DHußmann H(2019)Guidance in Cinematic Virtual Reality-Taxonomy, Research Status and ChallengesMultimodal Technologies and Interaction10.3390/mti30100193:1(19)Online publication date: 19-Mar-2019
https://doi.org/10.3390/mti3010019
Show More Cited By

Index Terms

IRIDiuM+: deep media storytelling with non-linear light field video
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
    2. Image manipulation

Recommendations

IRIDiuM: immersive rendered interactive deep media
SIGGRAPH '16: ACM SIGGRAPH 2016 VR Village

Compelling virtual reality experiences require high quality imagery as well as head motion with six degrees of freedom. Most existing systems limit the motion of the viewer (prerecorded fixed position 360 video panoramas), or are limited in realism, ...
Real-Time Global Illumination for VR Applications

Real-time global illumination in VR systems enhances scene realism by incorporating soft shadows, reflections of objects in the scene, and color bleeding. The Virtual Light Field (VLF) method enables real-time global illumination rendering in VR. The ...
ISSv3: from human motion in the real to the interactive documentary film in AR/VR
SA '16: SIGGRAPH ASIA 2016 Virtual Reality meets Physical Reality: Modelling and Simulating Virtual Humans and Environments

This is a small research-creation interactive augmented and virtual reality (AR/VR) documentary prototype. Its design extends the predecessor AR mobile app component incorporating AR footage previously only available in traditional mobile screen into a ...

Comments

Information & Contributors

Information

Published In

SIGGRAPH '17: ACM SIGGRAPH 2017 VR Village

July 2017

30 pages

ISBN:9781450350136

DOI:10.1145/3089269

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 July 2017

Check for updates

Author Tags

Qualifiers

Other

Funding Sources

Innovate UK

Conference

SIGGRAPH '17

Sponsor:

SIGGRAPH

SIGGRAPH '17: Special Interest Group on Computer Graphics and Interactive Techniques Conference

July 30 - August 3, 2017

California, Los Angeles

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
308
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zinovieva T(2024)Video Games As Deep Media: Challenges During The Russian-Ukrainian WarObraz10.21272/Obraz.2024.1(44)-45-5744:1(45-57)Online publication date: 2024
https://doi.org/10.21272/Obraz.2024.1(44)-45-57
Kroma AMaiden NSas C(2022)The Technical Dilemmas of Creative Design and Rapid Prototyping for Immersive StorytellingProceedings of the 14th Conference on Creativity and Cognition10.1145/3527927.3533730(698-703)Online publication date: 20-Jun-2022
https://dl.acm.org/doi/10.1145/3527927.3533730
Rothe SBuschek DHußmann H(2019)Guidance in Cinematic Virtual Reality-Taxonomy, Research Status and ChallengesMultimodal Technologies and Interaction10.3390/mti30100193:1(19)Online publication date: 19-Mar-2019
https://doi.org/10.3390/mti3010019
Harley DVerni AWillis MNg ABozzo LMazalek AFernaeus YMcMillan DJonsson MGirouard ATholander J(2018)Sensory VRProceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3173225.3173241(386-397)Online publication date: 18-Mar-2018
https://dl.acm.org/doi/10.1145/3173225.3173241
Chitalu FKoniaris BMitchell K(2017)Method for Efficient CPU-GPU Streaming for Walkthrough of Full Motion Lightfield VideoProceedings of the 14th European Conference on Visual Media Production (CVMP 2017)10.1145/3150165.3150173(1-9)Online publication date: 11-Dec-2017
https://dl.acm.org/doi/10.1145/3150165.3150173

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

IRIDiuM: immersive rendered interactive deep media

Real-Time Global Illumination for VR Applications

ISSv3: from human motion in the real to the interactive documentary film in AR/VR

Comments

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

IRIDiuM: immersive rendered interactive deep media

Real-Time Global Illumination for VR Applications

ISSv3: from human motion in the real to the interactive documentary film in AR/VR

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations