skip to main content
research-article

Collaborative behavior, performance and engagement with visual analytics tasks using mobile devices

Published: 22 November 2020 Publication History

Abstract

Interactive visualizations are external tools that can support users’ exploratory activities. Collaboration can bring benefits to the exploration of visual representations or visualizations. This research investigates the use of co-located collaborative visualizations in mobile devices, how users working with two different modes of interaction and view (Shared or Non-Shared) and how being placed at various position arrangements (Corner-to-Corner, Face-to-Face, and Side-by-Side) affect their knowledge acquisition, engagement level, and learning efficiency. A user study is conducted with 60 participants divided into 6 groups (2 modes × 3 positions) using a tool that we developed to support the exploration of 3D visual structures in a collaborative manner. Our results show that the shared control and view version in the Side-by-Side position is the most favorable and can improve task efficiency. In this paper, we present the results and a set of recommendations that are derived from them.

References

[1]
Isenberg P, Zuk T, Collins C, Carpendale S (2008) Grounded evaluation of information visualizations. In: Proceedings of the 2008 Workshop on BEyond time and errors: novel evaluation methods for Information Visualization (BELIV’08), Florence, Italy, 5 April 2008
[2]
Isenberg Petra, Elmqvist Niklas, Scholtz Jean, Cernea Daniel, Ma Kwan Liu, and Hagen Hans Collaborative visualization: definition, challenges, and research agenda Inf Vis 2011 10 4 310-326
[3]
Soares Anderson Gregório Marques, Dos Santos Carlos Gustavo Resque, De Paula Mendonça Sandro, Carneiro Nikolas Jorge Santiago, Miranda Brunelli Pinto, De Araújo Tiago Davi Oliveira, De Freitas Alexandre Abreu, De Morais Jefferson Magalhães, Meiguins Bianchi Serique (2016) A review of ways and strategies on how to collaborate in information visualization applications. In: Paper presented at the 20th International Conference Information Visualisation (IV), Lisbon, Portugal, 19–22 July 2016
[4]
Alallah F, Jin D, Irani P (2010) OA-graphs: orientation agnostic graphs for improving the legibility of charts on horizontal displays. In: Paper presented at the ACM international conference on interactive tabletops and surfaces, ITS 2010, Saarbrücken, Germany, 7–10 November 2010
[5]
Alvarez C, Brown C, and Nussbaum M Comparative study of netbooks and tablet PCs for fostering face-to-face collaborative learning Comput Hum Behav 2011 27 2 834-844
[6]
Haber J, Nacenta MA, Carpendale S (2014) Paper vs. tablets: the effect of document media in co-located collaborative work. In: Proceedings of the 2014 international working conference on advanced visual interfaces, Politecnico di Milano, Milan, Italy, 27–29 May 2014
[7]
Peter Hamilton, Daniel J. Wigdor (2014) Conductor: Enabling and Understanding Cross-Device Interaction. In: Proceedings of the SIGCHI conference on human factors in computing systems, Toronto Ontario, Canada, April 2014
[8]
Hinckley Ken (2003) Synchronous gestures for multiple persons and computers. In: Proceedings of the 16th annual ACM symposium on User interface software and technology (UIST’03), Vancouver, Canada, 2–5 November 2003
[9]
Marquardt Nicolai, Hinckley Ken, Greenberg Saul (2012) Cross-device interaction via micro-mobility and f-formations. In: Proceedings of the 25th annual ACM symposium on user interface software and technology (UIST’12), Cambridge, MA, USA, 7–10 October 2012
[10]
Rädle R, Jetter H-C, Marquardt N, Reiterer H, Rogers Y (2014) Huddlelamp: Spatially-Aware mobile displays for ad-hoc around-the-table collaboration. In: Proceedings of the ninth ACM international conference on interactive tabletops and surfaces (ITS’14), Dresden, Germany, 16–19 November 2014
[11]
Wozniak Pawel, Goyal Nitesh, Kucharski Przemys, Lischke Lars, Mayer Sven, Fjeld Morten (2016) RAMPARTS: Supporting Sensemaking with Spatially-Aware Mobile Interactions. In: Proceedings of the 2016 CHI conference on human factors in computing systems, San Jose, CA, USA, 7–12 May 2016
[12]
Anderson R, Chung O, Davis KM, Davis P, Prince C, Razmov V, Simon B (2006) Classroom presenter-A classroom interaction system for active and collaborative learning. The impact of tablet PCs and pen-based technology on education, 5 pages
[13]
Benford Steve Collaborative virtual environments Commun ACM 2001 44 7 79-85
[14]
Goodwin Kristy (2012) Use of tablet technology in the classroom. NSW Department of Education and Communities 2012
[15]
Koile Kimberle, Singer David (2006) Development of a tablet-PC-based system to increase instructor-student classroom interactions and student learning. The impact of tablet PCs and pen-based technology on education: vignettes, evaluations, and future directions. pp 115–122
[16]
Tutty Jodi, White Barbara (2006) Tablet classroom interactions. In: Proceedings of the 8th Australasian conference on computing education, Hobart, Australia, 2016
[17]
Garcia-Sanjuan F, Jurdi S, Jaen J, and Nacher V Evaluating a tactile and a tangible multi-tablet gamified quiz system for collaborative learning in primary education Comput Educ 2018 123 65-84
[18]
Liu CC and Kao LC Do handheld devices facilitate face-to-face collaboration? Handheld devices with large shared display groupware to facilitate group interactions J Comput Assist Learn 2007 23 4 285-299
[19]
Luyten Kris, Verpoorten Kristof, Coninx Karin (2007) Ad-hoc co-located collaborative work with mobile devices. In: Proceedings of the 9th international conference on Human computer interaction with mobile devices and services (MobileHCI’07), Singapore, 9–12 September 2007
[20]
Vanhulst P, Evequoz F, Tuor R, and Lalanne D A descriptive attribute-based framework for annotations in data visualization Int Joint Conf Comput Vis Imaging Comput Graph 2018 2018 143-166
[21]
Wu D, Liu B, Yang Q, and Wang R Social-aware cooperative caching mechanism in mobile social networks J Netw Comput Appl 2020 149 102457
[22]
Mandryk RL, Scott SD, and Inkpen KM Display factors influencing co-located collaboration Conf Suppl ACM CSCW 2002 2 10
[23]
Inkpen K, Hawkey K, Kellar M, Mandryk R, Parker K, Reilly D, Whalen T (2005) Exploring display factors that influence co-located collaboration: angle, size, number, and user arrangement. In: Proceedings of HCI international, Las Vegas, Nevada, USA, 22–27 July 2005
[24]
Isenberg Petra, Fisher Danyel, Paul Sharoda A, Morris Meredith Ringel, Inkpen Kori, and Czerwinski Mary Co-located collaborative visual analytics around a tabletop display IEEE Trans Vis Comput Graph 2011 18 5 689-702
[25]
Jakobsen Mikkel R and Hornbæk Kasper Up close and personal: collaborative work on a high-resolution multitouch wall display ACM Trans Comput-Hum Interact (TOCHI) 2014 21 2 1-34
[26]
Tang Anthony, Tory Melanie, Po Barry, Neumann Petra, Carpendale Sheelagh (2006) Collaborative coupling over tabletop displays. In: Proceedings of the SIGCHI conference on Human Factors in computing systems (CHI’06), Montréal Québec, Canada, April 2006
[27]
Billinghurst M, Cordeil M, Bezerianos A, Margolis T (2018) Collaborative immersive analytics. Immersive analytics, Springer 2018:221–257
[28]
Leftheriotis I, Chorianopoulos K, and Jaccheri L Design and implement chords and personal windows for multi-user collaboration on a large multi-touch vertical display Hum-Cent Comput Inf Sci 2016 6 1 1-19
[29]
Langner R, Kister U, and Dachselt R Multiple coordinated views at large displays for multiple users: empirical findings on user behavior, movements, and distances IEEE Trans Vis Comput Graph 2018 25 1 608-618
[30]
Brudy Frederik, Budiman Joshua Kevin, Houben Steven, Marquardt Nicolai (2018) Investigating the Role of an Overview Device in Multi-Device Collaboration. In: Proceedings of the 2018 CHI conference on human factors in computing systems (CHI ’18), Montréal, Canada, 21–26 April 2018
[31]
Konkel MK, Ullmer B, Shaer O, Mazalek A, Branton C (2020) Toward tangibles and display-rich interfaces for co-located and distributed genomics collaborations. Pers Ubiquit Comput 1–13
[32]
McGrath W, Bowman B, McCallum D, Hincapié-Ramos JD, Elmqvist N, Irani P (2012) Branch-explore-merge: facilitating real-time revision control in collaborative visual exploration. In: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces, Cambridge Massachusetts, USA, November 2012
[33]
Seifert Julian, Simeone Adalberto, Schmidt Dominik, Holleis Paul, Reinartz Christian, Wagner Matthias, Gellersen Hans, Rukzio Enrico (2012) MobiSurf: improving co-located collaboration through integrating mobile devices and interactive surfaces. In: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces (ITS’12), Cambridge Massachusetts, USA, November 2012
[34]
Zagermann Johannes, Pfeil Ulrike, Rädle Roman, Jetter Hans-Christian, Klokmose Clemens, Reiterer Harald (2016) When Tablets meet Tabletops: The Effect of Tabletop Size on Around-the-Table Collaboration with Personal Tablets. In: Proceedings of the 2016 CHI conference on human factors in computing systems (CHI’16), San Jose, CA, USA, 7–12 May 2016
[35]
Selwyn-Smith B, Anslow C, Homer M, Wallace JR (2019) Co-located Collaborative Block-Based Programming. In: Paper presented at the 2019 IEEE symposium on visual languages and human-centric computing (VL/HCC), Memphis, TN, USA, 15–17 October 2019
[36]
Wallace James R, Scott Stacey D, MacGregor Carolyn G (2013) Collaborative sensemaking on a digital tabletop and personal tablets. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI’13), Paris, France, 27 April-2 May 2013
[37]
Jeong DH, Ji SY, Suma EA, Yu B, and Chang R Designing a collaborative visual analytics system to support users’ continuous analytical processes Hum-Cent Comput Inf Sci 2015 5 1 1-20
[38]
Konkel MK, Ullmer B, Shaer O, Mazalek A (2019) Envisioning tangibles and display-rich interfaces for co-located and distributed genomics collaborations. In: Proceedings of the 8th ACM international symposium on pervasive displays, Palermo, Italy, 12–14 June 2019
[39]
Bishop F, Zagermann J, Pfeil U, Sanderson G, Reiterer H, and Hinrichs U Construct-A-Vis: exploring the free-form visualization processes of children IEEE Trans Vis Comput Graph 2019 26 1 451-460
[40]
Heer Jeffrey, Viégas Fernanda B, and Wattenberg Martin Voyagers and voyeurs: supporting asynchronous collaborative visualization Commun ACM 2009 52 1 87-97
[41]
Tobiasz Matthew, Isenberg Petra, and Carpendale Sheelagh Lark: coordinating co-located collaboration with information visualization IEEE Trans Vis Comput Graph 2009 15 6 1065-1072
[42]
Desolda G, Ardito C, Jetter HC, and Lanzilotti R Exploring spatially-aware cross-device interaction techniques for mobile collaborative sensemaking Int J Hum-Comput Stud 2019 122 1-20
[43]
Legg P, Smith J, and Downing A Visual analytics for collaborative human-machine confidence in human-centric active learning tasks Hum-Cent Comput Inf Sci 2019 9 1 5
[44]
Chung Haeyong, Yang Seungwon, Massjouni Naveed, Andrews Christopher, Kanna Rahul, North Chris (2010) VizCept: Supporting synchronous collaboration for constructing visualizations in intelligence analysis. In: Paper presented at the 2010 IEEE symposium on visual analytics science and technology, Salt Lake City, Utah, USA, 24–29 October 2010
[45]
Isenberg Petra and Fisher Danyel Collaborative brushing and linking for Co-located visual analytics of document collections Comput Graph Forum 2009 28 3 1031-1038
[46]
Hemmings M, Krahn R, Lary D, McGeer R, Ricart G, Röder M (2016) The ignite distributed collaborative scientific visualization system. The GENI Book. Springer, Berlin, pp 451–477
[47]
Balakrishnan Aruna D, Fussell Susan R, Kiesler Sara (2008) Do visualizations improve synchronous remote collaboration? In: Proceeding of the 26th annual CHI conference on Human factors in computing systems, Florence, Italy, 5–10 April 2008
[48]
Chuah Mei C, Roth Steven F (2003) Visualizing common ground. In: Proceedings of the international conference on information visualization, London, UK, 16–18 July 2003
[49]
Moraes Alessandro C, Eler Danilo M, Brega Jose RF (2014) Collaborative Information Visualization Using a Multi-projection System and Mobile Devices. In: Paper presented at the 18th international conference on information visualisation, Paris, France, 16–18 July 2014
[50]
Ens B, Lanir J, Tang A, Bateman S, Lee G, Piumsomboon T, and Billinghurst M Revisiting collaboration through mixed reality: the evolution of groupware Int J Hum-Comput Stud 2019 131 81-98
[51]
Greenberg Saul Sharing views and interactions with single-user applications ACM SIGOIS Bull 1990 11 2–3 227-237
[52]
Papangelis K, Chamberlain A, Lykourentzou I, Khan VJ, Saker M, Liang HN, SADIEN I, and Cao T. Performing the digital self: understanding location-based social networking, territory, space, and identity in the City ACM Trans Comput-Hum Interact 2020 27 1 1-26
[53]
Papangelis K, Metzger M, Sheng Y, Liang HN, Chamberlain A, Khan VJ (2017) “Get Off My Lawn!” Starting to Understand Territoriality in Location Based Mobile Games. In: Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems, Denver Colorado, USA, May 2017
[54]
Larsen-Ledet I and Korsgaard H Territorial functioning in collaborative writing Comput Support Cooper Work (CSCW) 2019 28 3–4 391-433
[55]
Scott SD, Carpendale MST, Inkpen KM (2004) Territoriality in collaborative tabletop workspaces. In: Proceedings of the 2004 ACM conference on computer supported cooperative work, Baltimore, Maryland, USA, 15–19 February 2004
[56]
Tse E, Histon J, Scott SD, Greenberg S (2004) Avoiding Interference: How People Use Spatial Separation and Partitioning in SDG Workspaces. In: Proceedings of the 2004 ACM conference on computer supported cooperative work, Baltimore, Maryland, USA, 15–19 February 2004
[57]
Albertos-Marco F, Penichet VM, and Gallud JA Foundations for distributing the interaction: facilitating universal access through Responsive Cross-Device Applications Univ Access Inf Soc 2019 18 4 821-835
[58]
Xu Y, Wang L, Xu Y, Qiu S, Xu M, Meng X (2019) Cross-device task interaction framework between the smart watch and the smart phone. Personal and Ubiquitous Computing 1–11
[59]
Forlines Clifton, Lilien Ryan (2008) Adapting a Single-User, Single-Display Molecular Visualization Application for Use in a Multi-User, Multi-Display Environment. In: Proceedings of the working conference on advanced visual interfaces (AVI’08), Napoli, Italy, 28–30 May 2008
[60]
Liu Can, Chapuis Olivier, Beaudouin-Lafon Michel, Lecolinet Eric (2016) Shared Interaction on a Wall-Sized Display in a Data Manipulation Task. In: Proceedings of the 2016 CHI conference on human factors in computing systems (CHI’16), San Jose, CA, USA, 7–12 May 2016
[61]
Hinckley Ken (2003) Distributed and Local Sensing Techniques for Face-to-Face Collaboration. In: Proceedings of the 5th international conference on Multimodal interfaces, Vancouver, British Columbia, Canada, 5–7 November 2003
[62]
Kaufmann Hannes, Schmalstieg Dieter (2002) AR008\_Mathematics and geometry education with collaborative augmented reality. In: Paper presented at the ACM SIGGRAPH 2002 conference abstracts and applications, San Antonio, Texas, USA, 21–26 July 2002
[63]
Huang Z, Zhu Y, Mao X, Su T, Fu X, Fei G (2020) coisTable: An Individual-and-Spatial-Aware Tabletop System for Co-located Collaboration. In: Paper presented at the 6th international conference on dependable systems and their applications (DSA), Harbin, China, 3–6 January 2020
[64]
Chung H and North C SAViL: cross-display visual links for sensemaking in display ecologies Pers Ubiquit Comput 2018 22 2 409-431
[65]
Kraut Robert E, Gergle Darren, Fussell Susan R (2002) The Use of Visual Information in Shared Visual Spaces - Informing the Development of Virtual Co-Presence. In: Proceedings of the international conference on computer supported cooperative work (CSCW’02), New Orleans, Louisiana, USA, 16–20 November 2002
[66]
Thomas P, Hans-christian J, Roman R, Nylandsted KC, Thomas L, Harald R (2017) Is Two Enough?! Studying Benefits, Barriers, and Biases of Multi-Tablet Use for Collaborative Visualization. In: Proceedings of the 2017 CHI conference on human factors in computing systems (CHI’17), Denver, CO, USA, 06–11 May 2017
[67]
Georgiou Yiannis and Kyza Eleni A Bridging narrative and locality in mobile-based augmented reality educational activities: effects of semantic coupling on students’ immersion and learning gains Int J Hum Comput Stud 2020 2020 102546
[68]
Sommer R Personal space: the behavioural basis of design 1969 Upper Saddle-River Prentice-Hall
[69]
Ha V, Inkpen KM, Mandryk RL, Whalen T (2006) Direct intentions: The effects of input devices on collaboration around a tabletop display. In: Paper presented at the first IEEE international workshop on horizontal interactive human-computer systems (TABLETOP’06), Adelaide, Australia, 5–7 January 2006
[70]
Rodden T, Rogers Y, Halloran J, Taylor I (2003) Designing Novel Interactional Workspaces to Support Face to Face Consultations. In: Proceedings of the ACM CHI 2003 human factors in computing systems conference, Ft. Lauderdale, Florida, USA, 5–10 April 2003
[71]
Liang Hai Ning and Sedig Kamran Can interactive visualization tools engage and support pre-university students in exploring non-trivial mathematical concepts? Comput Educat 2010 54 4 972-991
[72]
Luff Paul, Heath Christian (1998) Mobility in collaboration. In: Proceedings of the 1998 ACM conference on computer supported cooperative work (CSCW’98), Seattle, WA, USA, 14–18 November 1998
[73]
Liaqat A, Munteanu C (2019) Social Learning Frameworks for Analyzing Collaboration with Marginalized Learners. In: Paper presented at the conference companion publication of the 2019 on computer supported cooperative work and social computing, Austin, Texas, 9–13 November 2019
[74]
Phelps Erin and Damon William Problem solving with equals: peer collaboration as a context for learning mathematics and spatial concepts J Educ Psychol 1989 81 4 639-646
[75]
Mintz R, Litvak S, and Yair Y 3D-virtual reality in science education: an implication for astronomy teaching J Comput Math Sci Teach 2001 20 3 293-305
[76]
Sedig Kamran, Rowhani Sonja, and Liang Hai Ning Designing interfaces that support formation of cognitive maps of transitional processes: An empirical study Interact Comput 2005 17 4 419-452
[77]
Liang HN and Sedig K Role of interaction in enhancing the epistemic utility of 3D mathematical visualizations Int J Comput Math Learn 2010 15 3 191-224
[78]
Roberts Jonathan C (2007) State of the Art: Coordinated & Multiple Views in Exploratory Visualization. In: Paper presented at the fifth international conference on coordinated and multiple views in exploratory visualization (CMV’07), Zurich, Switzerland, July 2007
[79]
Ballas James A, Heitmeyer Constance L, Pérez Manuel A (1992) Evaluating two aspects of direct manipulation in advanced cockpits. In: Proceedings of the SIGCHI conference on Human factors in computing systems, Monterey, California, 3–7 June 1992
[80]
Carini Robert M, Kuh George D, and Klein Stephen P Student engagement and student learning: testing the linkages Res High Educ 2006 47 1 1-32
[81]
SEQ Student engagement questionnaire. https://www.surveymonkey.com/r/B53PZH8. Accessed 07 July 2019
[82]
Hutchins EL, Hollan JD, and Norman DA Direct manipulation interfaces Hum Comput Interact 1985 1 4 311-338
[83]
Sedig Kamran, Klawe Maria, and Westrom Marvin Role of interface manipulation style and scaffolding on cognition and concept learning in learnware ACM Trans Comput Hum Interact 2001 8 1 34-59
[84]
Christenson Sandra L, Reschly Amy L, and Wylie Cathy Handbook of research on student engagement 2012 New York Springer
[85]
Hung Ya-hsin, Parsons Paul (2017) Assessing User Engagement in Information Visualization. In: Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems (CHI EA’17), Denver, CO, USA, 06–11 May 2017
[86]
Ens Barrett, Lanir Joel, Tang Anthony, Bateman Scott, Lee Gun, Piumsomboon Thammathip, and Billinghurst Mark Revisiting collaboration through mixed reality: The evolution of groupware Int J Hum Comput Stud 2019 131 81-98
[87]
Lu F, Yu D, Liang HN, Chen W, Papangelis K, Ali NM (2018) Evaluating engagement level and analytical support of interactive visualizations in virtual reality environments. In: Paper presented at 2018 IEEE international symposium on mixed and augmented reality (ISMAR), Darmstadt, Germany, 16–20 October 2018
[88]
Martikainen, S., Wikström, V., Falcon, M., Saarikivi, K. (2019) Collaboration Face-to-Face and in Virtual Reality-Empathy, Social Closeness, and Task Load. Paper presented at the conference companion publication of the 2019 on computer supported cooperative work and social computing, Austin, Texas, 9–13 November 2019
[89]
Liang HN, Lu F, Shi Y, Nanjappan V, and Papangelis K Evaluating the effects of collaboration and competition in navigation tasks and spatial knowledge acquisition within virtual reality environments Future Gener Comput Syst 2019 95 855-866
[90]
Wu H, Luo W, Pan N, Nan S, Deng Y, Fu S, and Yang L Understanding freehand gestures: a study of freehand gestural interaction for immersive VR shopping applications Hum Cent Comput Inf Sci 2019 9 1 43
[91]
Nanjappan V, Liang HN, Lu F, Papangelis K, Yue Y, and Man KL User-elicited dual-hand interactions for manipulating 3D objects in virtual reality environments Hum Cent Comput Inf Sci 2018 8 1 31
[92]
Zhang F, Wu TY, Pan JS, Ding G, and Li Z Human motion recognition based on SVM in VR art media interaction environment Hum Cent Comput Inf Sci 2019 9 1 40

Cited By

View all
  • (2024)Communication, Collaboration, and Coordination in a Co-located Shared Augmented Reality Game: Perspectives From Deaf and Hard of Hearing PeopleProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642953(1-14)Online publication date: 11-May-2024
  • (2024)Feasibility and performance enhancement of collaborative control of unmanned ground vehicles via virtual realityPersonal and Ubiquitous Computing10.1007/s00779-024-01799-428:3-4(579-595)Online publication date: 1-Aug-2024
  • (2023)Side-by-Side vs Face-to-Face: Evaluating Colocated Collaboration via a Transparent Wall-sized DisplayProceedings of the ACM on Human-Computer Interaction10.1145/35796237:CSCW1(1-29)Online publication date: 16-Apr-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Human-centric Computing and Information Sciences
Human-centric Computing and Information Sciences  Volume 10, Issue 1
Dec 2020
952 pages
ISSN:2192-1962
EISSN:2192-1962
Issue’s Table of Contents

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 22 November 2020
Accepted: 02 November 2020
Received: 28 July 2020

Author Tags

  1. Computer-supported cooperative work/learning
  2. Collaborative visualizations
  3. Visual analytics
  4. User study
  5. User engagement
  6. Mobile tablets
  7. IoT

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 04 Feb 2025

Other Metrics

Citations

Cited By

View all

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media