research-article

Deep shot: a framework for migrating tasks across devices using mobile phone cameras

Authors:

Tsung-Hsiang Chang,

Yang LiAuthors Info & Claims

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2163 - 2172

https://doi.org/10.1145/1978942.1979257

Published: 07 May 2011 Publication History

Abstract

A user task often spans multiple heterogeneous devices, e.g., working on a PC in the office and continuing the work on a laptop or a mobile phone while commuting on a shuttle. However, there is a lack of support for users to easily migrate their tasks across devices. To address this problem, we created Deep Shot, a framework for capturing the user's work state that is needed for a task (e.g., the specific part of a webpage being viewed) and resuming it on a different device. In particular, Deep Shot supports two novel and intuitive interaction techniques, deep shooting and deep posting, for pulling and pushing work states, respectively, using a mobile phone camera. In addition, Deep Shot provides a concise API for developers to leverage its services and make their application states migratable. We demonstrated that Deep Shot can be used to support a range of everyday tasks migrating across devices. An evaluation consisting of a series of experiments showed that our framework and techniques are feasible.

Supplementary Material

MP4 File (paper849.mp4)

Download
68.04 MB

References

[1]

Bandelloni, R. and PaternF, F. Migratory User Interfaces Able To Adapt To Various Interaction Platforms. International journal of human-computer studies, 2004.

[2]

Bardram, JE. Activity-Based Computing: Support For Mobility And Collaboration In Ubiquitous Computing. Personal and Ubiquitous Computing, 2005.

Digital Library

[3]

Bardram, JE., Bunde-Pedersen, J., and Soegaard, M. Support For Activity-Based Computing In A Personal Computing Operating System. Proc. CHI '06.

Digital Library

[4]

Bay, H., Tuytelaars, T., and Van Gool, L. SURF: Speeded Up Robust Features. Proc. CVIU, 2008.

Digital Library

[5]

Boring, S., Altendorfer, M., Broll, G., and et al. Shoot & Copy: Phonecam-Based Information Transfer From Public Displays Onto Mobile Phones. Proc. Mobility '07.

Digital Library

[6]

Boring, S., Baur, D., Butz, A., and et al. Touch Projector: Mobile Interaction through Video. Proc. CHI '10.

Digital Library

[7]

Dearman, D and Pierce, JS. "It's On My Other Computer!": Computing With Multiple Devices. Proc. CHI '08.

Digital Library

[8]

Google Chrome to Phone. http://code.google.com/p/chrometophone.

[9]

Hinckley, K. Synchronous Gestures For Multiple Persons And Computers. Proc. UIST '03.

Digital Library

[10]

10. Hupp, D. and Miller, RC. Smart Bookmarks: Automatic Retroactive Macro Recording On The Web. Proc. UIST '07.

Digital Library

[11]

11. Karlson, A., Iqbal, S., Meyers, and Tang, J. Mobile Taskflow in Context: A Screenshot Study of Smartphone Usage. Proc. CHI '10.

Digital Library

[12]

12. Li, Y., and Landay, J. Activity-based prototyping of ubicomp applications for long-lived, everyday human activities, Proc. CHI'08.

Digital Library

[13]

13. Liao, C., Liu, Q., and et al. Pacer: Fine-grained Interactive Paper via Camera-touch Hybrid Gestures on a Cell Phone. Proc. CHI '10.

Digital Library

[14]

14. Liu, Q., McEvoy, P., and Lai, C.-J. Mobile camera supported document redirection. Proc. MM '06.

Digital Library

[15]

15. Miller, RC and Myers, BA. Synchronizing Clipboards Of Multiple Computers. Proc. UIST '99.

Digital Library

[16]

16. Pierce, J. and Nichols, J. An Infrastructure For Extending Applications' User Experiences Across Multiple Personal Devices. Proc. UIST '08.

Digital Library

[17]

17. Rekimoto, J. Pick-And-Drop: A Direct Manipulation Technique For Multiple Computer Environments. Proc. UIST '97.

Digital Library

[18]

18. Rekimoto, J and Saitoh, M. Augmented Surfaces: A Spatially Continuous Work Space For Hybrid Computing Environments. Proc. CHI '99.

Digital Library

[19]

19. Schilit, B and Sengupta, U. Device Ensembles. Computer, IEEE Computer Socity, 2004.

Digital Library

[20]

20. Tang, J., Lin, J., and et al. Recent Shortcuts: Using Recent Interactions To Support Shared Activities. Proc. CHI '07.

Digital Library

[21]

21. Tan, DS., Meyers, B., and Czerwinski, M. WinCuts: manipulating arbitrary window regions for more effective use of screen space. Proc. CHI '04.

Digital Library

[22]

22. Want, R, Fishkin, K, and Gujar, A. Bridging Physical And Virtual Worlds With Electronic Tags. Proc. CHI '99.

Digital Library

Cited By

Emmert MSchönwerth NSchmid AWolff CWimmer R(2024)I've Got the Data in My Pocket! - Exploring Interaction Techniques with Everyday Objects for Cross-Device Data TransferProceedings of Mensch und Computer 202410.1145/3670653.3670778(242-255)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670778
Liu YZhang ZPan YLi YLiang HCraig PYu L(2023)A Study of Zooming, Interactive Lenses and Overview+Detail Techniques in Collaborative Map-based Tasks2023 IEEE 16th Pacific Visualization Symposium (PacificVis)10.1109/PacificVis56936.2023.00009(11-20)Online publication date: Apr-2023
https://doi.org/10.1109/PacificVis56936.2023.00009
Qian JSun QWigington CHan HSun THealey JTompkin JHuang J(2022)Dually Noted: Layout-Aware Annotations with Smartphone Augmented RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502026(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502026
Show More Cited By

Index Terms

Deep shot: a framework for migrating tasks across devices using mobile phone cameras
1. Human-centered computing
  1. Human computer interaction (HCI)

Index terms have been assigned to the content through auto-classification.

Recommendations

Management of security policies for mobile devices
InfoSecCD '07: Proceedings of the 4th annual conference on Information security curriculum development

This paper discusses management of security policies for mobile devices. The increasing use of mobile devices in the workplace is covered, as well as new software applications that allow employees to use their mobile devices to increase their ...
Open project: a lightweight framework for remote sharing of mobile applications
UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technology

The form factor of mobile devices remains small while their computing power grows at an accelerated rate. Prior work has explored expanding the output space by leveraging free displays in the environment. However, existing solutions often do not scale. ...
Multimodal object oriented user interfaces in mobile affective interaction

In this paper, we investigate an object oriented (OO) architecture for multimodal emotion recognition in interactive applications through mobile phones or handheld devices. Mobile phones are different from desktop computers since mobile phones are not ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2011

3530 pages

ISBN:9781450302289

DOI:10.1145/1978942

General Chair:
Desney Tan
Microsoft Research
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Carl Gutwin
University of Saskatchewan
,
Bo Begole
PARC
,
Wendy A. Kellogg
IBM Research

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '11

Sponsor:

SIGCHI

CHI '11: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2011

BC, Vancouver, Canada

Acceptance Rates

CHI '11 Paper Acceptance Rate 410 of 1,532 submissions, 27%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

54
Total Citations
View Citations
1,416
Total Downloads

Downloads (Last 12 months)14
Downloads (Last 6 weeks)2

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Emmert MSchönwerth NSchmid AWolff CWimmer R(2024)I've Got the Data in My Pocket! - Exploring Interaction Techniques with Everyday Objects for Cross-Device Data TransferProceedings of Mensch und Computer 202410.1145/3670653.3670778(242-255)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670778
Liu YZhang ZPan YLi YLiang HCraig PYu L(2023)A Study of Zooming, Interactive Lenses and Overview+Detail Techniques in Collaborative Map-based Tasks2023 IEEE 16th Pacific Visualization Symposium (PacificVis)10.1109/PacificVis56936.2023.00009(11-20)Online publication date: Apr-2023
https://doi.org/10.1109/PacificVis56936.2023.00009
Qian JSun QWigington CHan HSun THealey JTompkin JHuang J(2022)Dually Noted: Layout-Aware Annotations with Smartphone Augmented RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502026(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502026
Chacón-Vázquez OMontané-Jiménez LOchoa-Rivera CHernández-Ocaña B(2021)Design of Platform to Support Workflow Continuity in Multi-Device ApplicationsAdvances in Science, Technology and Engineering Systems Journal10.25046/aj06011216:1(1091-1099)Online publication date: Feb-2021
https://doi.org/10.25046/aj0601121
Schmid AFischer TWeichart AHartmann AWimmer R(2021)Demonstrating ScreenshotMatcher: Taking Smartphone Photos to Capture ScreenshotsProceedings of Mensch und Computer 202110.1145/3473856.3474029(586-589)Online publication date: 5-Sep-2021
https://dl.acm.org/doi/10.1145/3473856.3474029
Schmid AFischer TWeichart AHartmann AWimmer R(2021)ScreenshotMatcher: Taking Smartphone Photos to Capture ScreenshotsProceedings of Mensch und Computer 202110.1145/3473856.3474014(44-48)Online publication date: 5-Sep-2021
https://dl.acm.org/doi/10.1145/3473856.3474014
Saidi HDubois ESerrano MKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)HoloBar: Rapid Command Execution for Head-Worn AR Exploiting Around the Field-of-View InteractionProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445255(1-17)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445255
Swearngin AIqbal SPoznanski VEncarnación MBennett PTeevan JKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Scraps: Enabling Mobile Capture, Contextualization, and Use of Document ResourcesProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445185(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445185
Huang ZLiu S(2021)Perceptual Hashing With Visual Content Understanding for Reduced-Reference Screen Content Image Quality AssessmentIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2020.302700131:7(2808-2823)Online publication date: Jul-2021
https://doi.org/10.1109/TCSVT.2020.3027001
Chen SWu HLin ZGuo CLin LHong FYuan X(2021)Photo4Action: phone camera-based interaction for graph visualizations on large wall displaysJournal of Visualization10.1007/s12650-021-00751-524:5(1083-1095)Online publication date: 1-Oct-2021
https://dl.acm.org/doi/10.1007/s12650-021-00751-5
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents