research-article

Public Access

Vremiere: In-Headset Virtual Reality Video Editing

Authors:

Stephen DiVerdi,

Aaron Hertzmann,

Feng LiuAuthors Info & Claims

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Pages 5428 - 5438

https://doi.org/10.1145/3025453.3025675

Published: 02 May 2017 Publication History

Abstract

Creative professionals are creating Virtual Reality (VR) experiences today by capturing spherical videos, but video editing is still done primarily in traditional 2D desktop GUI applications such as Premiere. These interfaces provide limited capabilities for previewing content in a VR headset or for directly manipulating the spherical video in an intuitive way. As a result, editors must alternate between editing on the desktop and previewing in the headset, which is tedious and interrupts the creative process. We demonstrate an application that enables a user to directly edit spherical video while fully immersed in a VR headset. We first interviewed professional VR filmmakers to understand current practice and derived a suitable workflow for in-headset VR video editing. We then developed a prototype system implementing this new workflow. Our system is built upon a familiar timeline design, but is enhanced with custom widgets to enable intuitive editing of spherical video inside the headset. We conducted an expert review study and found that with our prototype, experts were able to edit videos entirely within the headset. Experts also found our interface and widgets useful, providing intuitive controls for their editing needs.

Supplementary Material

ZIP File (pn2133-file4.zip)

Download
.79 KB

suppl.mov (pn2133-file3.mp4)

Supplemental video

Download
45.49 MB

suppl.mov (pn2133p.mp4)

Supplemental video

Download
12.29 MB

References

[1]

Natalia Bogdan, Tovi Grossman, and George Fitzmaurice. 2014. HybridSpace: Integrating 3D freehand input and stereo viewing into traditional desktop applications. In 2014 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 51--58.

[2]

Wutthigrai Boonsuk, Stephen Gilbert, and Jonathan Kelly. 2012. The impact of three interfaces for 360-degree video on spatial cognition. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '12. ACM Press, New York, New York, USA, 2579.

Digital Library

[3]

Jessica Brillhart. 2016a. In the Blink of a Mind - Attention. (2016). https://medium.com/the-language-of-vr/in-the-blink-of-a-mind-attention-1fdff60fa045

[4]

Jessica Brillhart. 2016b. In the Blink of a Mind - Prologue. (2016). https://medium.com/the-language-of-vr/in-the-blink-of-a-mind-prologue-7864c0474a29

[5]

Kai-Yin Cheng, Sheng-Jie Luo, Bing-Yu Chen, and Hao-Hua Chu. 2009. SmartPlayer: User-Centric Video Fast-Forwarding. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '09. ACM Press, New York, New York, USA, 789.

Digital Library

[6]

Andy Cockburn, Amy Karlson, and Benjamin B. Bederson. 2008. A review of overview+detail, zooming, and focus+context interfaces. Comput. Surveys 41, 1 (dec 2008), 1--31.

Digital Library

[7]

Kevin Fan, Liwei Chan, Daiya Kato, Kouta Minamizawa, and Masahiko Inami. 2016. VR Planet: Interface for Meta-View and Feet Interaction of VR Contents. In ACM SIGGRAPH 2016 VR Village on SIGGRAPH '16. ACM Press, New York, New York, USA, 1--2.

Digital Library

[8]

Ajoy S. Fernandes and Steven K. Feiner. 2016. Combating VR sickness through subtle dynamic field-of-view modification. In 2016 IEEE Symposium on 3D User Interfaces (3DUI). IEEE, 201--210.

[9]

Dustin E. R. Freeman, Stephanie Santosa, Fanny Chevalier, Ravin Balakrishnan, and Karan Singh. 2014. LACES: Live Authoring through Compositing and Editing of Streaming Video. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '14. ACM Press, New York, New York, USA, 1207--1216.

Digital Library

[10]

Edwin L. Hutchins, James D. Hollan, and Donald A. Norman. 1985. Direct Manipulation Interfaces. Human-Computer Interaction 1, 4 (dec 1985), 311--338.

Digital Library

[11]

Shunichi Kasahara and Jun Rekimoto. 2015. JackIn Head: Immersive Visual Telepresence System with Omnidirectional Wearable Camera for Remote Collaboration. In Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology VRST '15. ACM Press, New York, New York, USA, 217--225.

Digital Library

[12]

Robert S. Kennedy, Norman E. Lane, Kevin S. Berbaum, and Michael G. Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. The international journal of aviation psychology 3, 3 (1993), 203--220.

[13]

Don Kimber, Jonathan Foote, and Surapong Lertsithichai. 2001. FlyAbout: Spatially Indexed Panoramic Video. In Proceedings of the ninth ACM international conference on Multimedia - MULTIMEDIA '01. ACM Press, New York, New York, USA, 339.

Digital Library

[14]

Eugenia M. Kolasinski. 1995. Simulator Sickness in Virtual Environments. Technical Report. DTIC Document.

[15]

Johannes Kopf. 2016. 360 video stabilization: A new algorithm for smoother 360 video viewing. (2016). https://code.facebook.com/posts/697469023742261/360-video-stabilization-a-new-algorithm-for-smoother-360-video-viewing/

[16]

Oh-Hyun Kwon, Chris Muelder, Kyungwon Lee, and Kwan-Liu Ma. 2016. A Study of Layout, Rendering, and Interaction Methods for Immersive Graph Visualization. IEEE Transactions on Visualization and Computer Graphics 22, 7 (2016), 1802--1815.

Digital Library

[17]

Bruce D. Lucas and Takeo Kanade. 1981. An Iterative Image Registration Technique with an Application to Stereo Vision. In Proceedings of the 7th International Joint Conference on Artificial Intelligence - Volume 2 (IJCAI'81). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 674--679. http://dl.acm.org/citation.cfm?id=1623264.1623280

Digital Library

[18]

Alessandro Mulloni, Hartmut Seichter, Andreas Dünser, Patrick Baudisch, and Dieter Schmalstieg. 2012. 360° panoramic overviews for location-based services. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '12. ACM Press, New York, New York, USA, 2565.

Digital Library

[19]

Luís a. R. Neng and Teresa Chambel. 2010. Get around 360° hypervideo. In Proceedings of the 14th International Academic MindTrek Conference on Envisioning Future Media Environments - MindTrek '10. ACM Press, New York, New York, USA, 119.

[20]

Benjamin Petry and Jochen Huber. 2015. Towards effective interaction with omnidirectional videos using immersive virtual reality headsets. In Proceedings of the 6th Augmented Human International Conference on - AH '15. ACM Press, New York, New York, USA, 217--218.

Digital Library

[21]

Suporn Pongnumkul, Jue Wang, and Michael Cohen. 2008. Creating map-based storyboards for browsing tour videos. In Proceedings of the 21st annual ACM symposium on User interface software and technology UIST '08. ACM, New York, NY, USA, 13--22.

Digital Library

[22]

Gustavo Alberto Rovelo Ruiz, Davy Vanacken, Kris Luyten, Francisco Abad, and Emilio Camahort. 2014. Multi-viewer gesture-based interaction for omni-directional video. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '14. ACM Press, New York, New York, USA, 4077--4086.

Digital Library

[23]

Jonas Schild, Liane Bölicke, Joseph J. LaViola Jr., and Maic Masuch. 2013. Creating and analyzing stereoscopic 3D graphical user interfaces in digital games. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '13. ACM Press, New York, New York, USA, 169.

Digital Library

[24]

Klaus Schoeffmann, Marco A Hudelist, and Jochen Huber. 2015. Video Interaction Tools: A Survey of Recent Work. Comput. Surveys 48, 1 (sep 2015), 1--34.

Digital Library

[25]

Haijun Xia, Bruno Araujo, Tovi Grossman, and Daniel Wigdor. 2016. Object-Oriented Drawing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '16. ACM Press, New York, New York, USA, 4610--4621.

Digital Library

Cited By

Chidambaram SWilliams ABai MVirk SHaffner PLease MLi E(2024)Annorama: Enabling Immersive At-Desk Annotation Experiences in Virtual Reality with 3D Point Cloud DioramasProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682081(1-13)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682081
Spiess FScharowski NHaller AMemeti ZSchuldt HBrühlmann FGurrin CKongkachandra RSchoeffmann KDang-Nguyen DRossetto LSatoh SZhou L(2024)Bringing Video Browsing to Virtual Reality: Empirical Evaluation of a Novel Multimedia DrawerProceedings of the 2024 International Conference on Multimedia Retrieval10.1145/3652583.3658077(293-301)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3652583.3658077
Jin QLiu YYuan YHan BQian FYarosh S(2024)Virtual Reality, Real Pedagogy: A Contextual Inquiry of Instructor Practices with VR VideoProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642510(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642510
Show More Cited By

Index Terms

Vremiere: In-Headset Virtual Reality Video Editing
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

CollaVR: Collaborative In-Headset Review for VR Video
UIST '17: Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology

Collaborative review and feedback is an important part of conventional filmmaking and now Virtual Reality (VR) video production as well. However, conventional collaborative review practices do not easily translate to VR video because VR video is ...
Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology

In this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
SoEs: Attachable Augmented Haptic on Gaming Controller for Immersive Interaction
UIST '16 Adjunct: Adjunct Proceedings of the 29th Annual ACM Symposium on User Interface Software and Technology

We present SoEs (Sword of Elements), an attachable augmented haptic device for enhancing gaming controller in the immersive first-person game. Generally, Player can easily receive visual and auditory feedback through head-mounted displays (HMD) and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

May 2017

7138 pages

ISBN:9781450346559

DOI:10.1145/3025453

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
2,078
Total Downloads

Downloads (Last 12 months)231
Downloads (Last 6 weeks)30

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chidambaram SWilliams ABai MVirk SHaffner PLease MLi E(2024)Annorama: Enabling Immersive At-Desk Annotation Experiences in Virtual Reality with 3D Point Cloud DioramasProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682081(1-13)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682081
Spiess FScharowski NHaller AMemeti ZSchuldt HBrühlmann FGurrin CKongkachandra RSchoeffmann KDang-Nguyen DRossetto LSatoh SZhou L(2024)Bringing Video Browsing to Virtual Reality: Empirical Evaluation of a Novel Multimedia DrawerProceedings of the 2024 International Conference on Multimedia Retrieval10.1145/3652583.3658077(293-301)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3652583.3658077
Jin QLiu YYuan YHan BQian FYarosh S(2024)Virtual Reality, Real Pedagogy: A Contextual Inquiry of Instructor Practices with VR VideoProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642510(1-21)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642510
Coelho HMonteiro PGonçalves GMelo MBessa M(2024)Immersive Creation of Virtual Reality Training ExperiencesIEEE Access10.1109/ACCESS.2024.341333712(85773-85782)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3413337
Forero-Serna A(2024)Toward the Consolidation of Filming Simulators: A Systematic Literature Review of Virtual Environments for Audiovisual Learning and PracticeInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2383035(1-14)Online publication date: 25-Jul-2024
https://doi.org/10.1080/10447318.2024.2383035
Chen ZZhang KCai HDing XJiang CChen Z(2024)Audio-visual saliency prediction for movie viewing in immersive environments: Dataset and benchmarksJournal of Visual Communication and Image Representation10.1016/j.jvcir.2024.104095100(104095)Online publication date: Apr-2024
https://doi.org/10.1016/j.jvcir.2024.104095
Nafis FRose ASu SChen SHan B(2024)Are We There Yet? Unravelling Usability Challenges and Opportunities in Collaborative Immersive Analytics for Domain ExpertsHCI International 2024 – Late Breaking Papers10.1007/978-3-031-76812-5_12(159-181)Online publication date: 15-Dec-2024
https://doi.org/10.1007/978-3-031-76812-5_12
Liu SHenrikson RGrossman TGlueck MParent M(2023)RadarVR: Exploring Spatiotemporal Visual Guidance in Cinematic VRProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606734(1-14)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606734
Vermast AHürst W(2023)Introducing 3D Thumbnails to Access 360-Degree Videos in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324746229:5(2547-2556)Online publication date: 24-Feb-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3247462
Biener VOfek EPahud MKristensson PGrubert J(2023)Extended Reality for Knowledge Work in Everyday EnvironmentsEveryday Virtual and Augmented Reality10.1007/978-3-031-05804-2_2(21-56)Online publication date: 19-Feb-2023
https://doi.org/10.1007/978-3-031-05804-2_2
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents