research-article

PolarTrack: Optical Outside-In Device Tracking that Exploits Display Polarization

Authors:

Hans-Christian Jetter,

Jonathan Fischer,

Clemens N. Klokmose,

Harald Reiterer,

Christian HolzAuthors Info & Claims

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Paper No.: 497, Pages 1 - 9

https://doi.org/10.1145/3173574.3174071

Published: 21 April 2018 Publication History

Abstract

PolarTrack is a novel camera-based approach to detecting and tracking mobile devices inside the capture volume. In PolarTrack, a polarization filter continuously rotates in front of an off-the-shelf color camera, which causes the displays of observed devices to periodically blink in the camera feed. The periodic blinking results from the physical characteristics of current displays, which shine polarized light either through an LC overlay to produce images or through a polarizer to reduce light reflections on OLED displays. PolarTrack runs a simple detection algorithm on the camera feed to segment displays and track their locations and orientations, which makes PolarTrack particularly suitable as a tracking system for cross-device interaction with mobile devices. Our evaluation of PolarTrack's tracking quality and comparison with state-of-the-art camera-based multi-device tracking showed a better tracking accuracy and precision with similar tracking reliability. PolarTrack works as standalone multi-device tracking but is also compatible with existing camera-based tracking systems and can complement them to compensate for their limitations.

Supplementary Material

suppl.mov (pn4051-file3.mp4)

Supplemental video

Download
22.48 MB

suppl.mov (pn4051-file5.mp4)

Supplemental video

Download
16.60 MB

References

[1]

Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic Interaction: Designing for a Proximity and Orientation-Aware Environment. In ACM International Conference on Interactive Tabletops and Surfaces - ITS '10. ACM Press, New York, New York, USA, 121.

Digital Library

[2]

Frederik Brudy, Steven Houben, Nicolai Marquardt, and Yvonne Rogers. 2016. CurationSpace: Cross-Device Content Curation Using Instrumental Interaction. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces (ISS '16). ACM, New York, NY, USA, 159--168.

Digital Library

[3]

Nicholas Chen, François Guimbretière, and Abigail Sellen. 2013. Graduate student use of a multi-slate reading system. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI '13. ACM Press, New York, New York, USA, 1799.

Digital Library

[4]

R. Cok. 2004. OLED display with circular polarizer. (Sept. 30 2004). https://www.google.com/patents/US20040189196 US Patent App. 10/817,536.

[5]

Saul Greenberg, Nicolai Marquardt, Till Ballendat, Robert Diaz-Marino, and Miaosen Wang. 2011. Proxemic Interactions: The New Ubicomp? interactions 18, 1 (jan 2011), 42.

Digital Library

[6]

Jens Grubert and Matthias Kranz. 2017. HeadPhones: Ad Hoc Mobile Multi-Display Environments Through Head Tracking. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3966--3971.

Digital Library

[7]

Peter Hamilton and Daniel J. Wigdor. 2014. Conductor: enabling and understanding cross-device interaction. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14 (CHI '14). ACM Press, New York, New York, USA, 2773--2782.

Digital Library

[8]

Ken Hinckley, Gonzalo Ramos, Francois Guimbretiere, Patrick Baudisch, and Marc Smith. 2004. Stitching: pen gestures that span multiple displays. In Proceedings of the working conference on Advanced visual interfaces AVI '04. ACM Press, New York, New York, USA, 23.

Digital Library

[9]

Da-Yuan Huang, Chien-Pang Lin, Yi-Ping Hung, Tzu-Wen Chang, Neng-Hao Yu, Min-Lun Tsai, and Mike Y. Chen. 2012. MagMobile: enhancing social interactions with rapid view-stitching games of mobile devices. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia MUM '12 (MUM '12). ACM Press, New York, New York, USA, 1.

Digital Library

[10]

Haojian Jin, Christian Holz, and Kasper Hornbæk. 2015. Tracko: Ad-hoc Mobile 3D Tracking Using Bluetooth Low Energy and Inaudible Signals for Cross-Device Interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software&Technology (UIST '15). ACM, New York, NY, USA, 147--156.

Digital Library

[11]

Abhijit Karnik, Diego Martinez Plasencia, Walterio Mayol-Cuevas, and Sriram Subramanian. 2012a. PiVOT: Personalized View-overlays for Tabletops. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 271--280.

Digital Library

[12]

Abhijit Karnik, Walterio Mayol-Cuevas, and Sriram Subramanian. 2012b. MUSTARD: A Multi User See Through AR Display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2541--2550.

Digital Library

[13]

Ulrike Kister, Konstantin Klamka, Christian Tominski, and Raimund Dachselt. 2017. GraSp: Combining Spatially-aware Mobile Devices and a Display Wall for Graph Visualization and Interaction. Computer Graphics Forum, 36 36 (6 2017), 503--514.

Digital Library

[14]

Hideki Koike, Wataru Nishikawa, and Kentaro Fukuchi. 2009. Transparent 2-D Markers on an LCD Tabletop System. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 163--172.

Digital Library

[15]

Martin Kuechler and Andreas M. Kunz. 2010. Collaboard: A Remote Collaboration Groupware Device Featuring an Embodiment-enriched Shared Workspace. In Proceedings of the 16th ACM International Conference on Supporting Group Work (GROUP '10). ACM, New York, NY, USA, 211--214.

Digital Library

[16]

Ming Li and Leif Kobbelt. 2012. Dynamic tiling display: building an interactive display surface using multiple mobile devices. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia MUM '12. ACM Press, New York, New York, USA, 1.

Digital Library

[17]

David Lindlbauer, Toru Aoki, Robert Walter, Yuji Uema, Anita Höchtl, Michael Haller, Masahiko Inami, and Jörg Müller. 2014. Tracs: Transparency-control for See-through Displays. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 657--661.

Digital Library

[18]

Roman Lissermann, Jochen Huber, Martin Schmitz, Jürgen Steimle, and Max Mühlhäuser. 2014. Permulin: Mixed-focus Collaboration on Multi-view Tabletops. In Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 3191--3200.

Digital Library

[19]

Andrés Lucero, Jussi Holopainen, and Tero Jokela. 2011. Pass-them-around: collaborative use of mobile phones for photo sharing. In Proceedings of the 2011 annual conference on Human factors in computing systems - CHI '11, Vol. 54. ACM Press, New York, New York, USA, 1787.

Digital Library

[20]

Andrés Lucero, Jaakko Keränen, and Hannu Korhonen. 2010. Collaborative use of mobile phones for brainstorming. In Proceedings of the 12th international conference on Human computer interaction with mobile devices and services - MobileHCI '10. ACM Press, New York, New York, USA, 337.

Digital Library

[21]

Nicolai Marquardt, Robert Diaz-Marino, Sebastian Boring, and Saul Greenberg. 2011. The proximity toolkit: prototyping proxemic interactions in ubiquitous computing ecologies. In Proceedings of the 24th annual ACM symposium on User interface software and technology - UIST '11. ACM Press, New York, New York, USA, 315.

Digital Library

[22]

Nicolai Marquardt, Ken Hinckley, and Saul Greenberg. 2012. Cross-device interaction via micro-mobility and f-formations. In Proceedings of the 25th annual ACM symposium on User interface software and technology UIST '12. ACM Press, New York, New York, USA, 13.

Digital Library

[23]

Thomas Plank, Hans-Christian Jetter, Roman Rädle, Clemens N. Klokmose, Thomas Luger, and Harald Reiterer. 2017. Is Two Enough?: ! Studying Benefits, Barriers, and Biases of Multi-Tablet Use for Collaborative Visualization. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4548--4560.

Digital Library

[24]

Roman Rädle, Hans-Christian Jetter, Nicolai Marquardt, Harald Reiterer, and Yvonne Rogers. 2014. HuddleLamp: Spatially-Aware Mobile Displays for Ad-hoc Around-the-Table Collaboration. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces - ITS '14. ACM Press, New York, New York, USA, 45--54.

Digital Library

[25]

Roman Rädle, Hans-Christian Jetter, Mario Schreiner, Zhihao Lu, Harald Reiterer, and Yvonne Rogers. 2015. Spatially-aware or Spatially-agnostic?: Elicitation and Evaluation of User-Defined Cross-Device Interactions. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15. ACM Press, New York, New York, USA, 3913--3922.

Digital Library

[26]

Mario Schreiner, Roman Rädle, Hans-Christian Jetter, and Harald Reiterer. 2015. Connichiwa: A Framework for Cross-Device Web Applications. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '15. ACM Press, New York, New York, USA, 2163--2168.

Digital Library

[27]

Garth B. D. Shoemaker and Kori M. Inkpen. 2001. Single Display Privacyware: Augmenting Public Displays with Private Information. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '01). ACM, New York, NY, USA, 522--529.

Digital Library

[28]

John C. Tang and Scott L. Minneman. 1990. VideoDraw: A Video Interface for Collaborative Drawing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '90). ACM, New York, NY, USA, 313--320.

Digital Library

[29]

Andrew D. Wilson and Hrvoje Benko. 2014. CrossMotion: Fusing Device and Image Motion for User Identification, Tracking and Device Association. In Proceedings of the 16th International Conference on Multimodal Interaction (ICMI '14). ACM, New York, NY, USA, 216--223.

Digital Library

[30]

Pawel Wozniak, Nitesh Goyal, Przemyslaw Kucharski, Lars Lischke, Sven Mayer, and Morten Fjeld. 2016. RAMPARTS: Supporting Sensemaking with Spatially-Aware Mobile Interactions. Proceedings of the SIGCHI Conference on Human Factors in Computing System 2016 (2016).

Digital Library

[31]

Chi-Jui Wu, Steven Houben, and Nicolai Marquardt. 2017. EagleSense: Tracking People and Devices in Interactive Spaces Using Real-Time Top-View Depth-Sensing. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3929--3942.

Digital Library

[32]

Johannes Zagermann, Ulrike Pfeil, Roman Rädle, Hans-Christian Jetter, Clemens Klokmose, and Harald Reiterer. 2016. When Tablets meet Tabletops: The Effect of Tabletop Size on Around-the-Table Collaboration with Personal Tablets. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems CHI '16. ACM Press, New York, New York, USA, 5470--5481.

Digital Library

Cited By

Nakamura ATakemura K(2024)Extracting Corneal Reflection of Screen by High-Speed Control of PolarizationCompanion Proceedings of the 2024 Conference on Interactive Surfaces and Spaces10.1145/3696762.3698048(33-36)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3696762.3698048
Beyeler MCheng YHolz C(2023)Cross-Device Shortcuts: Seamless Attention-guided Content Transfer via Opportunistic Deep Links between Apps and DevicesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614145(125-134)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614145
Brudy FHolz CRädle RWu CHouben SKlokmose CMarquardt NBrewster SFitzpatrick GCox AKostakos V(2019)Cross-Device TaxonomyProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300792(1-28)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300792

Index Terms

PolarTrack: Optical Outside-In Device Tracking that Exploits Display Polarization
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Demonstrating XDTK: Prototyping Multi-Device Interaction and Arbitration in XR
UIST Adjunct '24: Adjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology

The interaction space of XR head-mounted devices can be extended by leveraging other digital devices, such as phones, tablets, and smartwatches. We present a demonstration of XDTK (Cross-Device Toolkit), an open-sourced prototyping toolkit for multi-...
Intent-driven input device arbitration for XR
CHI EA '24: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems

Interactions with Extended Reality Head-Mounted Displays (XR HMDs) require precise, intuitive, and efficient input methods. Current approaches either rely on power-intensive sensors, such as cameras for hand tracking, or specialized hardware such as ...
PanoSwarm: Collaborative and Synchronized Multi-Device Panoramic Photography
IUI '16: Proceedings of the 21st International Conference on Intelligent User Interfaces

Taking a picture has been traditionally a one-person task. In this paper we present a novel system that allows multiple mobile devices to work collaboratively in a synchronized fashion to capture a panorama of a highly dynamic scene, creating an ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

April 2018

8489 pages

ISBN:9781450356206

DOI:10.1145/3173574

General Chairs:
Regan Mandryk
University of Saskatchewan, Canada
,
Mark Hancock
University of Waterloo, Canada
,
Program Chairs:
Mark Perry
Brunel University London, UK
,
Anna Cox
University College London, UK

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 April 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Aarhus University Research Foundation
Innovation Fund Denmark

Conference

CHI '18

Sponsor:

SIGCHI

CHI '18: CHI Conference on Human Factors in Computing Systems

April 21 - 26, 2018

Montreal QC, Canada

Acceptance Rates

CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
314
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)2

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nakamura ATakemura K(2024)Extracting Corneal Reflection of Screen by High-Speed Control of PolarizationCompanion Proceedings of the 2024 Conference on Interactive Surfaces and Spaces10.1145/3696762.3698048(33-36)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3696762.3698048
Beyeler MCheng YHolz C(2023)Cross-Device Shortcuts: Seamless Attention-guided Content Transfer via Opportunistic Deep Links between Apps and DevicesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614145(125-134)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614145
Brudy FHolz CRädle RWu CHouben SKlokmose CMarquardt NBrewster SFitzpatrick GCox AKostakos V(2019)Cross-Device TaxonomyProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300792(1-28)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300792

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents