skip to main content
10.1145/3078810.3078823acmconferencesArticle/Chapter ViewAbstractPublication PagesperdisConference Proceedingsconference-collections
research-article

Audience monitor: an open source tool for tracking audience mobility in front of pervasive displays

Published: 07 June 2017 Publication History

Abstract

Understanding an audience's behavior is an important aspect of evaluating display installations. In particular, it is important to understand how people move around in the vicinity of displays, including viewer transitions from noticing a display, through approach, to final use of the display. Despite the importance of measuring viewer mobility patterns, there are still relatively few low-cost tools that can be used with research display deployments to capture detailed spatial and temporal behavior of an audience. In this paper, we present an approach to audience monitoring that uses an off-the-shelf depth sensor and open source computer vision algorithms to monitor the space in front of a digital display, tracking presence and movements of both passers-by and display users. We believe that our approach can help display researchers evaluate their public display deployments and improve the level of quantitative data underpinning our field.

References

[1]
S. Ali and M. Shah, „Floor Fields for Tracking in High Density Crowd Scenes," In Proceedings of the 10th European Conference on Computer Vision: Part II (ECCV '08), David Forsyth, Philip Torr, and Andrew Zisserman (Eds.). Springer-Verlag, Berlin, Heidelberg, pp 1--14, 2008.
[2]
Florian Alt, Stefan Schneegaß, Albrecht Schmidt, Jörg Müller, and Nemanja Memarovic. 2012. How to evaluate public displays. In Proceedings of the 2012 International Symposium on Pervasive Displays (PerDis '12). ACM, NY, USA.
[3]
Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic interaction: designing for a proximity and orientation-aware environment. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 121--130.
[4]
Harry Brignull and Yvonne Rogers. Enticing people to interact with large public displays in public spaces. In In Proceedings of the IFIP International Conference on Human-Computer Interaction (INTERACT 2003), pages 17--24, 2003.
[5]
A. B. Chan, Z. S. J. Liang, N. Vasconcelos, "Privacy preserving crowd monitoring: Counting people without people models or tracking," IEEE Conference on Computer Vision and Pattern Recognition, 2008.
[6]
N. Davies, M. Langheinrich, R. Jose and A. Schmidt, "Open Display Networks: A Communications Medium for the 21st Century," in Computer, vol. 45, no. 5, pp. 58--64, May 2012.
[7]
Nigel Davies, Marc Langheinrich, Sarah Clinch, Ivan Elhart, Adrian Friday, Thomas Kubitza, and Bholanathsingh Surajbali. 2014. Personalisation and privacy in future pervasive display networks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, NY, USA, 2357--2366.
[8]
Ivan Elhart, Marc Langheinrich, Nemanja Memarovic, Elisa Rubegni (2016) A good balance of costs and benefits: convincing a university administration to support the installation of an interactive multi-application display system on campus, Proceedings of the 5th ACM International Symposium on Pervasive Displays - PerDis '16, p. 197--203, New York, New York, USA.
[9]
Ivan Elhart, Marc Langheinrich, Nemanja Memarovic, Tommi Heikkinen (2014) Scheduling Interactive and Concurrently Running Applications in Pervasive Display Networks, Proceedings of The International Symposium on Pervasive Displays - PerDis '14, p. 104--109, New York, New York, USA.
[10]
Farinella, G. M., Farioli, G., Battiato, S., Leonardi, S., and Gallo, G. Face re-identification for digital signage applications. In Video Analytics for Audience Measurement (2014), Springer.
[11]
Tom Fawcett. 2006. An introduction to ROC analysis. Pattern Recogn. Lett. 27, 8 (June 2006), 861--874.
[12]
Fraunhofer IIS. Fraunhofer AVARD. http://www.iis.fraunhofer.de/en/ff/bsy/tech/bildanalyse/avard.html
[13]
Nicholas Gillian, Sara Pfenninger, Spencer Russell, and Joseph A. Paradiso. 2014. Gestures Everywhere: A Multimodal Sensor Fusion and Analysis Framework for Pervasive Displays. In Proceedings of The International Symposium on Pervasive Displays (PerDis '14), Sven Gehring (Ed.). ACM, New York, NY, USA.
[14]
Intel Corporation. Intel AIM Suite. https://aimsuite.intel.com/
[15]
Michelis, D., and Müller, J. 2011. The Audience Funnel: Observations of Gesture Based Interaction With Multiple Large Displays in a City Center. Int. J. of HCI 27, 6 (May 2011), 562 -- 579.
[16]
Shahram Izadi, David Kim, Otmar Hilliges, David Molyneaux, Richard Newcombe, Pushmeet Kohli, Jamie Shotton, Steve Hodges, Dustin Freeman, Andrew Davison, and Andrew Fitzgibbon. 2011. KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11). ACM, NY, USA, 559--568.
[17]
M. Mikusz, S. Clinch, R. Jones, M. Harding, C. Winstanley and N. Davies, "Repurposing Web Analytics to Support the IoT," in Computer, vol. 48, no. 9, pp. 42--49, Sept. 2015.
[18]
Nemanja Memarovic, Ivan Elhart, Marc Langheinrich (2011) FunSquare: first experiences with autopoiesic content, Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia - MUM '11, p. 175--184, New York, New York, USA: ACM Press
[19]
Nemanja Memarovic, Ivan Elhart, and Elisa Rubegni. 2016. "Fun place within a serious space": stimulating community interaction and engagement through situated snapshots in a university setting. In Proceedings of the 15th International Conference on Mobile and Ubiquitous Multimedia (MUM '16). ACM.
[20]
Jörg Müller, Juliane Exeler, Markus Buzeck, and Antonio Krüger. 2009. ReflectiveSigns: Digital Signs That Adapt to Audience Attention. In Proceedings of the 7th International Conference on Pervasive Computing (Pervasive '09), Hideyuki Tokuda, Michael Beigl, Adrian Friday, A. J. Brush, and Yoshito Tobe (Eds.). Springer-Verlag, Berlin, Heidelberg, 17--24.
[21]
Timo Ojala, Hannu Kukka, Tomas Lindén, Tommi Heikkinen, Marko Jurmu, Simo Hosio, and Fabio Kruger. 2010. UBI-Hotspot 1.0: Large-Scale Long-Term Deployment of Interactive Public Displays in a City Center. In Proceedings of the 2010 Fifth International Conference on Internet and Web Applications and Services (ICIW '10), Washington, DC, USA, 285--294.
[22]
Stefan Seer, Norbert Brändle, Carlo Ratti. 2014. Kinects and human kinetics: A new approach for studying pedestrian behavior. In Transportation Research Part C: Emerging Technologies, Volume 48, November 2014, 212--228.
[23]
Jiamin Shi and Florian Alt. 2016. The Anonymous Audience Analyzer: Visualizing Audience Behavior in Public Space. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 3766--3769.
[24]
Richard Szeliski. Computer vision: algorithms and applications. Springer Science & Business Media, 2010.
[25]
Phil Tian, Addicam V. Sanjay, Kunapareddy Chiranjeevi, and Shahzad Malik Malik. 2012. Intelligent advertising framework for digital signage. In Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD '12). ACM, New York, NY, USA, 1532--1535.
[26]
Daniel Vogel and Ravin Balakrishnan. 2004. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In Proceedings of the 17th annual ACM symposium on User interface software and technology (UIST '04). ACM, New York, NY, USA, 137--146.
[27]
Julie R. Williamson and John Williamson. 2014. Analysing Pedestrian Traffic Around Public Displays. In Proceedings of the International Symposium on Pervasive Displays (PerDis '14), ACM, NY, USA.
[28]
Chi-Jui Wu, Aaron Quigley and David Harris-Birtill. 2017. Personal and Ubiquitous Computing (2017) 21: 125.

Cited By

View all

Index Terms

  1. Audience monitor: an open source tool for tracking audience mobility in front of pervasive displays

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    PerDis '17: Proceedings of the 6th ACM International Symposium on Pervasive Displays
    June 2017
    186 pages
    ISBN:9781450350457
    DOI:10.1145/3078810
    • General Chair:
    • Marc Langheinrich,
    • Program Chair:
    • Sarah Clinch
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 07 June 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. audience monitoring
    2. display deployments
    3. display evaluation
    4. public displays

    Qualifiers

    • Research-article

    Conference

    PerDis '17
    Sponsor:

    Acceptance Rates

    PerDis '17 Paper Acceptance Rate 21 of 38 submissions, 55%;
    Overall Acceptance Rate 213 of 384 submissions, 55%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)10
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 24 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media