research-article

A Touchless Gestural System for Extended Information Access Within a Campus

Authors:

Salvatore Sorce,

Antonio Gentile,

Alessio Malizia,

Fabrizio MilazzoAuthors Info & Claims

SIGUCCS '17: Proceedings of the 2017 ACM SIGUCCS Annual Conference

Pages 37 - 43

https://doi.org/10.1145/3123458.3123459

Published: 01 October 2017 Publication History

Abstract

In the last two decades, we have witnessed a growing spread of touchless interfaces, facilitated by higher performances of computational systems, as well as the increased availability of cheaper sensors and devices. Putting the focus on gestural input, several researchers and designers used Kinect-like devices to implement touchless gestural interfaces. The latter extends the possible deployments and usage of public interactive displays. For example, wall-sized displays may become interactive even if they are unreachable by touch. Moreover, billboard-sized displays may be placed in safe cases to avoid vandalism, while still maintaining their interactivity. Finally, people with temporary or permanent physical impairment (e.g. wheelchair users) may still comfortably interact with the display. Here we describe an information provision system allowing for touchless gestural interactions, along with a trial implementation within our University campus to test its effectiveness in a real setting. Our system is intended for use by students, lecturers and staff members, providing a captivating way to access news, lectures information, videos and more. We also report the results of an ongoing user study, defining a set of guidelines for future designs.

References

[1]

Fabrizio Milazzo, Vito Gentile, Giuseppe Vitello, Antonio Gentile, and Salvatore Sorce. Modular Middleware for Gestural Data and Devices Management. Journal of Sensors, 2017, 2017.

[2]

Matthias Hank Haeusler. Media Facades-History, Technology, Content. Avedition, 2009.

[3]

Sven Gehring and Alexander Wiethoff. Interaction with Media Façades. Informatik-Spektrum, 37(5):474--482, 2014.

[4]

Meredith Ringel Morris, Andreea Danielescu, Steven Drucker, Danyel Fisher, Bongshin Lee, Jacob O Wobbrock, et al. Reducing Legacy Bias in Gesture Elicitation Studies. Interactions, 21(3):40--45, 2014.

Digital Library

[5]

Andries Van Dam. Post-WIMP User Interfaces. Communications of the ACM, 40(2):63--67, 1997.

Digital Library

[6]

Jörg Müller, Dennis Wilmsmann, Juliane Exeler, Markus Buzeck, Albrecht Schmidt, Tim Jay, and Antonio Krüger. Display Blindness: The Effect of Expectations on Attention towards Digital Signage. In Proceedings of the 7th International Conference on Pervasive Computing, pages 1--8. Springer-Verlag, 2009.

Digital Library

[7]

Vito Gentile, Alessio Malizia, Salvatore Sorce, and Antonio Gentile. Designing Touchless Gestural Interactions for Public Displays In-the-Wild. In International Conference on Human-Computer Interaction, pages 24--34. Springer, 2015.

[8]

Vito Gentile, Mohamed Khamis, Salvatore Sorce, and Florian Alt. They are Looking at me! Understanding how Audience Presence Impacts on Public Display Users. In Proceedings of the 6th International Symposium on Pervasive Displays (PerDis 2017). ACM, 2017.

Digital Library

[9]

Microsoft. Human interface guidelines 2.0. http://download.microsoft.com/download/6/7/6/676611B4-1982-47A4-A42E-4CF84E1095A8/KinectHIG.2.0.pdf, 2013. Accessed: 2017-04-29.

[10]

Paolo Cremonesi, Antonella Di Rienzo, Cristina Frà, Franca Garzotto, Luigi Oliveto, and Massimo Valla. Personalized Interaction on Large Displays: the StreetSmart Project Approach. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces, pages 353--354. ACM, 2014.

Digital Library

[11]

Vito Gentile, Salvatore Sorce, Giuseppe Russo, Dario Pirrone, and Antonio Gentile. A Multimodal Fruition Model for Graphical Contents in Ancient Books. In Proceedings of the 17th International Conference on Computer Systems and Technologies 2016, CompSysTech 16, pages 65--72, New York, NY, USA, 2016. ACM.

Digital Library

[12]

Nigel Davies, Sarah Clinch, and Florian Alt. Pervasive displays: understanding the future of digital signage. Synthesis Lectures on Mobile and Pervasive Computing, 8(1):1--128, 2014.

[13]

Elaine Huang, Anna Koster, and Jan Borchers. Overcoming assumptions and uncovering practices: When does the public really look at public displays? Pervasive Computing, pages 228--243, 2008.

Digital Library

[14]

Brian J Fogg. Persuasive technology: using computers to change what we think and do. Ubiquity, 2002(December):5, 2002.

Digital Library

[15]

John Hardy, Enrico Rukzio, and Nigel Davies. Real world responses to interactive gesture based public displays. In Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia, MUM '11, pages 33--39, New York, NY, USA, 2011. ACM.

Digital Library

[16]

Robert Walter, Gilles Bailly, and Jörg Müller. Strikeapose: Revealing mid-air gestures on public displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '13, pages 841--850, New York, NY, USA, 2013. ACM.

Digital Library

[17]

Timo Ojala, Vassilis Kostakos, Hannu Kukka, Tommi Heikkinen, Tomas Linden, Marko Jurmu, Simo Hosio, Fabio Kruger, and Daniele Zanni. Multipurpose interactive public displays in the wild: Three years later. Computer, 45(5):42--49, 2012.

Digital Library

[18]

Till Ballendat, Nicolai Marquardt, and Saul Greenberg. Proxemic interaction: Designing for a proximity and orientation-aware environment. In ACM International Conference on Interactive Tabletops and Surfaces, ITS '10, pages 121--130, New York, NY, USA, 2010. ACM.

Digital Library

[19]

Daniel Vogel and Ravin Balakrishnan. Interactive public ambient displays: Transitioning from implicit to explicit, public to personal, interaction with multiple users. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology, UIST '04, pages 137--146, New York, NY, USA, 2004. ACM.

Digital Library

[20]

Jörg Müller, Florian Alt, Daniel Michelis, and Albrecht Schmidt. Requirements and design space for interactive public displays. In Proceedings of the 18th ACM International Conference on Multimedia, MM '10, pages 1285--1294, New York, NY, USA, 2010. ACM.

Digital Library

[21]

Johannes Schönböck, Florian König, Gabriele Kotsis, Dominik Gruber, Emre Zaim, and Albrecht Schmidt. Mirrorboard-an interactive billboard. In Mensch & Computer, pages 217--226, 2008.

[22]

Jörg Müller, Gilles Bailly, Thor Bossuyt, and Niklas Hillgren. Mirrortouch: combining touch and mid-air gestures for public displays. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services, pages 319--328. ACM, 2014.

Digital Library

[23]

Ivan Elhart, Federico Scacchi, Evangelos Niforatos, and Marc Langheinrich. Shadowtouch: A multi-user application selection interface for interactive public displays. In Proceedings of the 4th International Symposium on Pervasive Displays, PerDis '15, pages 209--216, New York, NY, USA, 2015. ACM.

Digital Library

[24]

Robert Walter, Gilles Bailly, Nina Valkanova, and Jörg Müller. Cuenesics: using mid-air gestures to select items on interactive public displays. In Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services, pages 299--308. ACM, 2014.

Digital Library

[25]

Vito Gentile, Salvatore Sorce, Alessio Malizia, Dario Pirrello, and Antonio Gentile. Touchless interfaces for public displays: Can we deliver interface designers from introducing artificial push button gestures? In Proceedings of the International Working Conference on Advanced Visual Interfaces, AVI '16, pages 40--43, New York, NY, USA, 2016. ACM.

Digital Library

[26]

Vito Gentile, Salvatore Sorce, Alessio Malizia, and Antonio Gentile. Gesture recognition using low-cost devices: Techniques, applications, perspectives {Riconoscimento di gesti mediante dispositivi a basso costo: Tecniche, applicazioni, prospettive}. Mondo Digitale, 15(63):161--169, 2016.

[27]

Niels Wouters, John Downs, Mitchell Harrop, Travis Cox, Eduardo Oliveira, Sarah Webber, Frank Vetere, and Andrew Vande Moere. Uncovering the honeypot effect: How audiences engage with public interactive systems. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems, DIS '16, pages 5--16, New York, NY, USA, 2016. ACM.

Digital Library

Cited By

Friedman ACafaro F(2024)Designing Gestures for Data Exploration with Public Displays via Identification StudiesInformation10.3390/info1506029215:6(292)Online publication date: 21-May-2024
https://doi.org/10.3390/info15060292
Xie JZheng HLin JTang X(2024)Digital Gamification Design of Chinese Landscape Painting Based on Gesture InteractionHCI in Games10.1007/978-3-031-60692-2_10(127-142)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60692-2_10
Vatavu RUngurean OBilius L(2022)Interactive Public Displays and Wheelchair Users: Between Direct, Personal and Indirect, Assisted InteractionProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545662(1-17)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545662
Show More Cited By

Index Terms

A Touchless Gestural System for Extended Information Access Within a Campus
1. Human-centered computing
  1. Human computer interaction (HCI)
  2. Interaction design
    1. Empirical studies in interaction design

Recommendations

Touchless gestural interaction with small displays: a case study
CHItaly '13: Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI

Touchless gestural interaction enables users to interact with digital devices using body movements and gestures, and without the burden of a physical contact with technology (e.g., data gloves, body markers, or remote controllers). Most gesture-based ...
Demonstrating Proxemic Cursor Input for Touchless Displays
SUI '23: Proceedings of the 2023 ACM Symposium on Spatial User Interaction

Touchless gesture interfaces often use cursor-based interactions, where widgets are targeted by a movable cursor and activated with a mid-air gesture. Proxemic cursor interactions are a novel alternative that facilitate faster selection without the need ...
Tangible Meets Gestural: Comparing and Blending Post-WIMP Interaction Paradigms
TEI '15: Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction

More and more objects of our everyday environment are becoming smart and connected, offering us new interaction possibilities. Tangible interaction and gestural interaction are promising communication means with these objects in this post-WIMP ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGUCCS '17: Proceedings of the 2017 ACM SIGUCCS Annual Conference

October 2017

220 pages

ISBN:9781450349192

DOI:10.1145/3123458

General Chair:
Cate Lyon
Whitman College
,
Program Chairs:
Kristen Dietiker
Menlo College
,
Chris Wiesemann
University of Oregon

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGUCCS: ACM Special Interest Group on University and College Computing Services

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Ministero dell'Istruzione, dell'Università e della Ricerca

Conference

SIGUCCS '17

Sponsor:

SIGUCCS

SIGUCCS '17: ACM SIGUCCS Annual Conference

October 1 - 4, 2017

Washington, Seattle, USA

Acceptance Rates

Overall Acceptance Rate 123 of 170 submissions, 72%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
181
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 02 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Friedman ACafaro F(2024)Designing Gestures for Data Exploration with Public Displays via Identification StudiesInformation10.3390/info1506029215:6(292)Online publication date: 21-May-2024
https://doi.org/10.3390/info15060292
Xie JZheng HLin JTang X(2024)Digital Gamification Design of Chinese Landscape Painting Based on Gesture InteractionHCI in Games10.1007/978-3-031-60692-2_10(127-142)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-60692-2_10
Vatavu RUngurean OBilius L(2022)Interactive Public Displays and Wheelchair Users: Between Direct, Personal and Indirect, Assisted InteractionProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545662(1-17)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545662
Pearson JBailey GRobinson SJones MOwen TZhang CReitmaier TSteer CCarter ASahoo DRaju D(2022)Can’t Touch This: Rethinking Public Technology in a COVID-19 EraProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501980(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501980
Rubegni EGentile VMalizia ASorce SKargas N(2020)Child–display interaction: Lessons learned on touchless avatar-based large display interfacesPersonal and Ubiquitous Computing10.1007/s00779-020-01451-x26:3(667-680)Online publication date: 30-Oct-2020
https://doi.org/10.1007/s00779-020-01451-x
Gentile VAdjorlu ASerafin SRocchesso DSorce SKhamis MSorce SCauchard JGentile V(2019)Touch or touchless?Proceedings of the 8th ACM International Symposium on Pervasive Displays10.1145/3321335.3324946(1-7)Online publication date: 12-Jun-2019
https://dl.acm.org/doi/10.1145/3321335.3324946
Rubegni EGentile VMalizia ASorce SKargas NKhamis MSorce SCauchard JGentile V(2019)Child-display interactionProceedings of the 8th ACM International Symposium on Pervasive Displays10.1145/3321335.3324942(1-7)Online publication date: 12-Jun-2019
https://dl.acm.org/doi/10.1145/3321335.3324942
Koutsabasis PVogiatzidakis P(2019)Empirical Research in Mid-Air Interaction: A Systematic ReviewInternational Journal of Human–Computer Interaction10.1080/10447318.2019.1572352(1-22)Online publication date: 5-Feb-2019
https://doi.org/10.1080/10447318.2019.1572352

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten