research-article

Visual separation in mobile multi-display environments

Authors:

Jessica R. Cauchard,

Markus Löchtefeld,

Johannes Schoening,

Antonio Krüger,

Sriram SubramanianAuthors Info & Claims

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

Pages 451 - 460

https://doi.org/10.1145/2047196.2047256

Published: 16 October 2011 Publication History

Abstract

Projector phones, handheld game consoles and many other mobile devices increasingly include more than one display, and therefore present a new breed of mobile Multi-Display Environments (MDEs) to users. Existing studies illustrate the effects of visual separation between displays in MDEs and suggest interaction techniques that mitigate these effects. Currently, mobile devices with heterogeneous displays such as projector phones are often designed without reference to visual separation issues; therefore it is critical to establish whether concerns and opportunities raised in the existing MDE literature apply to the emerging category of Mobile MDEs (MMDEs). This paper investigates the effects of visual separation in the context of MMDEs and contrasts these with fixed MDE results, and explores design factors for Mobile MDEs. Our study uses a novel eye-tracking methodology for measuring switches in visual context between displays and identifies that MMDEs offer increased design flexibility over traditional MDEs in terms of visual separation. We discuss these results and identify several design implications.

Supplementary Material

JPG File (fp188.jpg)

Download
7.49 KB

M4V File (fp188.m4v)

Download
45.03 MB

References

[1]

Ankrum, D. R. Visual Ergonomics in the Office - Guidelines. Technical Report, 1999.

[2]

Baudisch, P., Cutrell, E., Hinckley, K. and Gruen, R. Mouse ether: accelerating the acquisition of targets across multi-monitor displays. In CHI '04 EA, ACM, 2004, pp. 1379--1382.

Digital Library

[3]

Benko, H. and Feiner, S. Multi-monitor mouse. In CHI '05 EA, ACM, 2005, pp. 1208--1211.

Digital Library

[4]

Benko, H. and Feiner, S. Pointer warping in heterogeneous multi-monitor environments. In Proceedings of Graphics Interface 2007, ACM, 2007, pp. 111--117.

Digital Library

[5]

Bi, X., Bae, S.-H. and Balakrishnan, R. Effects of interior bezels of tiled-monitor large displays on visual search, tunnel steering, and target selection. In CHI 2010, ACM, 2010, pp. 65--74.

Digital Library

[6]

Cao, X., Forlines, C. and Balakrishnan, R. Multi-user interaction using handheld projectors. In UIST 2007, ACM, 2007, pp. 43--52.

Digital Library

[7]

Cauchard, J. R., Fraser, M. and Subramanian, S. Offsetting Displays on Mobile Projector Phones. In Ubiprojection Workshop on Personal Projection at Pervasive 2010, pp. 3.

[8]

Chen, C.-H. and Chien, Y.-H. Effects of RSVP display design on visual performance in accomplishing dual tasks with small screens. International Journal of Design, 1, 2007, pp. 27--35.

[9]

Chen, N., Guimbretiere, F., Dixon, M., Lewis, C. and Agrawala, M. Navigation techniques for dual-display e-book readers. In CHI'08, ACM, pp. 1779--1788.

Digital Library

[10]

Cowan, L. and Li, K. ShadowPuppets: Supporting Collocated Interaction with Mobile Projector Phones Using Hand Shadows. In CHI 2011, AC.

Digital Library

[11]

Dickie, C., Hart, J., Vertegaal, R. and Eiser, A. LookPoint: an evaluation of eye input for hands-free switching of input devices between multiple computers. In OZCHI '06, ACM, 2006, pp. 119--126.

Digital Library

[12]

Dickson, F. Pico Projectors: One Reason Bigger Isn't Better. Technical Report IN1004722WH, In-Stat, 2010.

[13]

Forlines, C., Shen, C., Wigdor, D. and Balakrishnan, R. Exploring the effects of group size and display configuration on visual search. In CSCW '06, ACM, 2006, pp. 11--20.

Digital Library

[14]

Greenberg, S., Boyle, M. and Laberge, J. PDAs and shared public displays: Making personal information public, and public information personal. Personal and Ubiquitous Computing, 3, 1999, pp. 54--64.

[15]

Grudin, J. Partitioning digital worlds: focal and peripheral awareness in multiple monitor use. In CHI 2001, ACM, 2001, pp. 458--465.

Digital Library

[16]

Hang, A., Rukzio, E. and Greaves, A. Projector phone: a study of using mobile phones with integrated projector for interaction with maps. In MobileHCI 2008, ACM, 2008, pp. 207--216.

Digital Library

[17]

Hinckley, K., Dixon, M., Sarin, R., Guimbretiere, F. and Balakrishnan, R. Codex: a dual screen tablet computer. In CHI'09, ACM, 2009, pp. 1933--1942.

Digital Library

[18]

Hinckley, K., Ramos, G., Guimbretiere, F., Baudisch, P. and Smith, M. Stitching: pen gestures that span multiple displays. In AVI 2004, ACM, pp. 23--31.

[19]

Kern, D., Marshall, P. and Schmidt, A. Gazemarks: gaze-based visual placeholders to ease attention switching. In CHI 2010, ACM, 2010, pp. 2093--2102.

Digital Library

[20]

Kirsh, D. and Maglio, P. On Distinguishing Epistemic from Pragmatic Action. Cognitive Science, 18, 1994, pp. 513--549.

[21]

Lyons, K., Pering, T., Rosario, B., Sud, S. and Want, R. Multi-display Composition: Supporting Display Sharing for Collocated Mobile Devices. In Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I, Springer-Verlag, 2009, pp. 758--771.

Digital Library

[22]

Mandryk, R. L., Rodgers, M. E. and Inkpen, K. M. Sticky widgets: pseudo-haptic widget enhancements for multi-monitor displays. In CHI '05 EA, ACM, 2005, pp. 1621--1624.

Digital Library

[23]

Matsumoto, T., Horiguchi, D., Nakashima, S. and Okude, N. Z-agon: mobile multi-display browser cube. In CHI '06 EA, ACM, 2006, pp. 351--356.

Digital Library

[24]

Merrill, D., Kalanithi, J. and Maes, P. Siftables: towards sensor network user interfaces. In TEI'07 ACM, 2007, pp. 75--78.

Digital Library

[25]

Nacenta, M. A., Sallam, S., Champoux, B., Subramanian, S. and Gutwin, C. Perspective cursor: perspective-based interaction for multi-display environments. In CHI'06, ACM, 2006, pp. 289--298.

Digital Library

[26]

Ota, S., Takegawa, Y., Terada, T. and Tsukamoto, M. A Method for Wearable Projector Selection that Considers the Viewability of Projected Images. Comput. Entertain. 8, 2010, pp. 1--16.

Digital Library

[27]

Pinhanez, C., Kjeldsen, R., Levas, A., Pingali, G., Podlaseck, M. and Sukaviriya, N. Applications of steerable projector-camera systems. In IEEE International Workshop on Projector-Camera Systems at ICCV 2003, IEEE Computer Society Press.

[28]

Su, R. and Bailey, B. P. Put Them Where? Towards Guidelines for Positioning Large Displays. In Proc. of Graphics Interface '05, 2005, pp. 337--349.

Digital Library

[29]

Tan, D. S. and Czerwinski, M. Effects of Visual Separation and Physical Discontinuities when Distributing Information across Multiple Displays. In Interact 2003, pp. 252--255.

[30]

Yang, X.-D., Mak, E., McCallum, D., Irani, P., Cao, X. and Izadi, S. LensMouse: augmenting the mouse with an interactive touch display. In CHI 2010, ACM, 2010, pp. 2431--2440.

Digital Library

Cited By

Hubenschmid SZagermann JLeicht DReiterer HFeuchtner T(2023)ARound the Smartphone: Investigating the Effects of Virtually-Extended Display Size on Spatial MemoryProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581438(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581438
Lin GHaynes MSrinivas SKotipalli PStarner T(2021)Towards Finding the Optimum Position in the Visual Field for a Head Worn Display Used for Task Guidance with Non-registered GraphicsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34480915:1(1-26)Online publication date: 30-Mar-2021
https://dl.acm.org/doi/10.1145/3448091
Bang SLee HWoo W(2020)Effects of Augmented Content’s Placement and Size on User’s Search Experience in Extended Displays2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct51615.2020.00056(184-188)Online publication date: Nov-2020
https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00056
Show More Cited By

Index Terms

Visual separation in mobile multi-display environments
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Mobile projectors versus mobile displays: an assessment of task performance
SAP '12: Proceedings of the ACM Symposium on Applied Perception

Mobile projectors are gaining momentum, with many pocket sized products reaching the market and projector phones being close to production. Although the usefulness of such devices for entertainment, collaboration as well as many other tasks is obvious, ...
Mobile multi-display environments
UIST '11 Adjunct: Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology

Mobile devices are increasingly being fitted with more than one display, presenting a new breed of Mobile Multi-Display Environments (MMDEs). It is however still unclear how the extra display fits within the mobile devices' ecology in terms of ...
Interactive Displays through Mobile Projection
MobileHCI '15: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct

Projectors shrink in size, are embedded in some mobile devices, and the next generation of mobile projections: drone-carried or wearable projectors are graspable. The technology may be ready for a radical change in mobile interaction towards personal ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

October 2011

654 pages

ISBN:9781450307161

DOI:10.1145/2047196

General Chair:
Jeff Pierce
IBM Research, USA
,
Program Chairs:
Maneesh Agrawala
University of California, Berkeley, USA
,
Scott Klemmer
Stanford University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '11

Sponsor:

UIST '11: The 24th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2011

California, Santa Barbara, USA

Acceptance Rates

UIST '11 Paper Acceptance Rate 67 of 262 submissions, 26%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Upcoming Conference

UIST '25

Sponsor:
sigchi
sigchi

The 38th Annual ACM Symposium on User Interface Software and Technology

September 28 - October 1, 2025

Busan , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

42
Total Citations
View Citations
1,195
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)9

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Hubenschmid SZagermann JLeicht DReiterer HFeuchtner T(2023)ARound the Smartphone: Investigating the Effects of Virtually-Extended Display Size on Spatial MemoryProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581438(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581438
Lin GHaynes MSrinivas SKotipalli PStarner T(2021)Towards Finding the Optimum Position in the Visual Field for a Head Worn Display Used for Task Guidance with Non-registered GraphicsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34480915:1(1-26)Online publication date: 30-Mar-2021
https://dl.acm.org/doi/10.1145/3448091
Bang SLee HWoo W(2020)Effects of Augmented Content’s Placement and Size on User’s Search Experience in Extended Displays2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)10.1109/ISMAR-Adjunct51615.2020.00056(184-188)Online publication date: Nov-2020
https://doi.org/10.1109/ISMAR-Adjunct51615.2020.00056
Eiberger AKristensson PMayr SKranz MGrubert J(2019)Effects of Depth Layer Switching between an Optical See-Through Head-Mounted Display and a Body-Proximate DisplaySymposium on Spatial User Interaction10.1145/3357251.3357588(1-9)Online publication date: 19-Oct-2019
https://dl.acm.org/doi/10.1145/3357251.3357588
Min CLee EPark SKang S(2019)TigerProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3340117(1-11)Online publication date: 1-Oct-2019
https://dl.acm.org/doi/10.1145/3338286.3340117
Brudy FHolz CRädle RWu CHouben SKlokmose CMarquardt NBrewster SFitzpatrick GCox AKostakos V(2019)Cross-Device TaxonomyProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300792(1-28)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300792
Khamis MAlt FBulling ABailie LOliver N(2018)The past, present, and future of gaze-enabled handheld mobile devicesProceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3229434.3229452(1-17)Online publication date: 3-Sep-2018
https://dl.acm.org/doi/10.1145/3229434.3229452
Zhang YRehg J(2018)Watching the TV WatchersProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/32142912:2(1-27)Online publication date: 5-Jul-2018
https://dl.acm.org/doi/10.1145/3214291
Brock AChatain JPark MFang THachet MLanday JCauchard J(2018)FlyMapProceedings of the 7th ACM International Symposium on Pervasive Displays10.1145/3205873.3205877(1-9)Online publication date: 6-Jun-2018
https://dl.acm.org/doi/10.1145/3205873.3205877
Marquardt NBrudy FLiu CBengler BHolz CMandryk RHancock MPerry MCox A(2018)SurfaceConstellationsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173928(1-14)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173928
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents