research-article

TouchPivot: Blending WIMP & Post-WIMP Interfaces for Data Exploration on Tablet Devices

Authors:

Jinwook SeoAuthors Info & Claims

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Pages 2660 - 2671

https://doi.org/10.1145/3025453.3025752

Published: 02 May 2017 Publication History

Abstract

Recent advancements in tablet technology pose a great opportunity for information visualization to expand its horizons beyond desktops. In this paper, we present TouchPivot, a novel interface that assists visual data exploration on tablet devices. With novices in mind, TouchPivot supports data transformations, such as pivoting and filtering, with simple pen and touch interactions, and facilitates understanding of the transformations through tight coupling between a data table and visualization. We bring in WIMP interfaces to TouchPivot, leveraging their familiarity and accessibility to novices. We report on a user study conducted to compare TouchPivot with two commercial interfaces, Tableau and Microsoft Excel's PivotTable. Our results show that novices not only answered data-driven questions faster, but also created a larger number of meaningful charts during freeform exploration with TouchPivot than others. Finally, we discuss the main hurdles novices encountered during our study and possible remedies for them.

Supplementary Material

suppl.mov (pn2489-file3.mp4)

Supplemental video

Download
90.81 MB

suppl.mov (pn2489p.mp4)

Supplemental video

Download
1.52 MB

MP4 File (p2660-jo.mp4)

Download
225.32 MB

References

[1]

Dominikus Baur, Bongshin Lee, and Sheelagh Carpendale. 2012. TouchWave: kinetic multi-touch manipulation for hierarchical stacked graphs. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS '12), 255--264.

Digital Library

[2]

John Brooke. 1996. SUS-a quick and dirty usability scale. Usability Evaluation in Industry 189, 104: 4--7.

[3]

Jeffrey Browne, Bongshin Lee, Sheelagh Carpendale, Nathalie Riche, and Timothy Sherwood. 2011. Data analysis on interactive whiteboards through sketchbased interaction. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11), 154--157.

Digital Library

[4]

Andrew Crotty, Alex Galakatos, Emanuel Zgraggen, Carsten Binnig, and Tim Kraska. 2015. Vizdom: interactive analytics through pen and touch. In Proceedings of the Very Large Data Base Endowment 8, 12: 2024--2027.

Digital Library

[5]

Steven M. Drucker, Danyel Fisher, Ramik Sadana, and Jessica Herron. 2013. TouchViz: a case study comparing two interfaces for data analytics on tablets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 2301--2310.

Digital Library

[6]

Micheline Elias and Anastasia Bezerianos. 2011. Exploration views: understanding dashboard creation and customization for visualization novices. In Proceedings of 13th IFIP Conference on HumanComputer Interaction (INTERACT '11), 274--291.

[7]

Mathias Frisch, Jens Heydekorn, and Raimund Dachselt. 2009. Investigating multi-touch and pen gestures for diagram editing on interactive surfaces. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '09), 149--156.

Digital Library

[8]

Lars Grammel, Chris Bennett, Melanie Tory, and Margaret-Anne Storey. 2013. A survey of visualization construction user interfaces, In EuroVis-Short Papers, Mario Hlawitschka and Tino Weinkauf (eds.). The Eurographics Association, 19--23.

[9]

Lars Grammel, Melanie Tory, and Margaret-Anne Storey. 2010. How information visualization novices construct visualizations. IEEE Transactions on Visualization and Computer Graphics (TVCG) 16, 6: 943--952.

Digital Library

[10]

Jeffrey Heer, Frank Van Ham, Sheelagh Carpendale, Chris Weaver, and Petra Isenberg. 2008. Creation and collaboration: engaging new audiences for information visualization. In Information Visualization, Andreas Kerren, John T. Stasko, Jean-Daniel Fekete, Chris North (eds.). Springer Berlin Heidelberg, 92--133.

Digital Library

[11]

Ken Hinckley, Koji Yatani, Michel Pahud, Nicole Coddington, Jenny Rodenhouse, Andy Wilson, Hrvoje Benko, and Bill Buxton. 2010. Pen + touch = new tools. In Proceedings of the 23nd annual ACM symposium on User interface software and technology (UIST '10), 27--36.

Digital Library

[12]

Dandan Huang, Melanie Tory, Bon Adriel Aseniero, Lyn Bartram, Scott Bateman, Sheelagh Carpendale, Anthony Tang, and Robert Woodbury. 2015. Personal visualization and personal visual analytics. IEEE Transactions on Visualization and Computer Graphics (TVCG) 21, 3: 420--433.

Digital Library

[13]

Petra Isenberg, Tobias Isenberg, Tobias Hesselmann, Bongshin Lee, Ulrich Von Zadow, and Anthony Tang. 2013. Data visualization on interactive surfaces: a research agenda. IEEE Computer Graphics and Applications (CG&A) 33, 2: 16--24.

Digital Library

[14]

Jaemin Jo, Bongshin Lee, and Jinwook Seo. 2015. WordlePlus: expanding wordle's use through natural interaction and animation. IEEE Computer Graphics and Applications (CG&A) 35, 6: 20--28.

Digital Library

[15]

Bongshin Lee, Petra Isenberg, Nathalie Henry Riche, and Sheelagh Carpendale. 2012. Beyond mouse and keyboard: expanding design considerations for information visualization interactions. IEEE Transactions on Visualization and Computer Graphics (TVCG) 18, 12: 2689--2698.

Digital Library

[16]

Bongshin Lee, Rubaiat Habib Kazi, and Greg Smith. 2013. SketchStory: telling more engaging stories with data through freeform sketching. IEEE Transactions on Visualization and Computer Graphics (TVCG) 19, 12: 2416--2425.

Digital Library

[17]

Bongshin Lee, Greg Smith, Nathalie Henry Riche, Amy Karlson, and Sheelagh Carpendale. 2015. SketchInsight: natural data exploration on interactive whiteboards leveraging pen and touch interaction. In Proceedings of 2015 IEEE Pacific Visualization Symposium (PacificVis '15), 199--206.

[18]

Sukwon Lee, Sung-Hee Kim, Ya-Hsin Hung, Heidi Lam, Youn-ah Kang, and Ji Soo Yi. 2016. How do people make sense of unfamiliar visualizations?: a grounded model of novice's information visualization sensemaking. IEEE Transactions on Visualization and Computer Graphics (TVCG) 22, 1: 499--508.

Digital Library

[19]

Christophe Leys, Christophe Ley, Olivier Klein, Philippe Bernard, and Laurent Licata. 2013. Detecting outliers: do not use standard deviation around the mean, use absolute deviation around the median. Journal of Experimental Social Psychology 49, 4: 764766.

[20]

Microsoft Excel 2016, Retrieved September 21, 2016 from https://products.office.com/en-us/excel

[21]

Jeff Miller. 1991. Short report: reaction time analysis with outlier exclusion: bias varies with sample size. The Quarterly Journal of Experimental Psychology 43, 4: 907--912.

[22]

Qlik Data Visualization Tools, Retrieved September 21, 2016 from http://www.qlik.com/us/

[23]

Donghao Ren, Tobias Höllerer, and Xiaoru Yuan. 2014. iVisDesigner: expressive interactive design of information visualizations. IEEE Transactions on Visualization and Computer Graphics (TVCG) 20, 12: 2092--2101.

[24]

Jeffrey M. Rzeszotarski and Aniket Kittur. 2014. Kinetica: naturalistic multi-touch data visualization. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14), 897--906.

Digital Library

[25]

Ramik Sadana and John Stasko. 2014. Designing and implementing an interactive scatterplot visualization for a tablet computer. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces (AVI '14), 265--272.

Digital Library

[26]

Ramik Sadana and John Stasko. 2016. Designing multiple coordinated visualizations for tablets. Computer Graphics Forum 35, 3: 261--270.

Digital Library

[27]

Ramik Sadana and John Stasko. 2016. Expanding selection for information visualization systems on tablet devices. In Proceedings of the 2016 ACM Conference on Interactive Surfaces and Spaces (ISS '16), 149--158.

Digital Library

[28]

Sebastian Schmidt, Miguel A. Nacenta, Raimund Dachselt, and Sheelagh Carpendale. 2010. A set of multi-touch graph interaction techniques. In Proceedings of the 2010 ACM International Conference on Interactive Tabletops and Surfaces (ITS '10), 113--116.

Digital Library

[29]

Student Performance Data Set. Retrieved September 21, 2016 from https://archive.ics.uci.edu/ml/datasets/Student+Perform ance

[30]

Tableau Software, Retrieved September 21, 2016 from http://www.tableau.com/

[31]

Vizable by Tableau. Retrieved September 21, 2016 from https://vizable.tableau.com/

[32]

Julie Wagner, Stéphane Huot, and Wendy Mackay. 2012. BiTouch and BiPad: designing bimanual interaction for hand-held tablets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 2317--2326.

Digital Library

[33]

Jagoda Walny, Bongshin Lee, Paul Johns, Nathalie Henry Riche, and Sheelagh Carpendale. 2012. Understanding pen and touch interaction for data exploration on interactive whiteboards. IEEE Transactions on Visualization and Computer Graphics (TVCG) 18, 12: 2779--2788.

Digital Library

[34]

Colin Ware. 2012. Information Visualization: Perception for Design. Elsevier.

Digital Library

[35]

Kanit Wongsuphasawat, Dominik Moritz, Anushka Anand, Jock Mackinlay, Bill Howe, and Jeffrey Heer. 2016. Voyager: exploratory analysis via faceted browsing of visualization recommendations. IEEE Transactions on Visualization and Computer Graphics (TVCG) 22, 12: 649--658.

Digital Library

[36]

Emanuel Zgraggen, Robert Zeleznik, and Steven M. Drucker. 2014. PanoramicData: data analysis through pen & touch. IEEE Transactions on Visualization and Computer Graphics (TVCG) 20, 12: 2112--2121.

Cited By

L’Yi Svan den Brandt AAdams ENguyen HGehlenborg N(2025)Learnable and Expressive Visualization Authoring Through Blended InterfacesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345659831:1(459-469)Online publication date: Jan-2025
https://doi.org/10.1109/TVCG.2024.3456598
van den Brandt AL'Yi SNguyen HVilanova AGehlenborg N(2025)Understanding Visualization Authoring Techniques for Genomics Data in the Context of Personas and TasksIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345629831:1(1180-1190)Online publication date: Jan-2025
https://doi.org/10.1109/TVCG.2024.3456298
Polidoro FLiu YCraig P(2024)Enhancing Mobile Visualisation Interactivity: Insights on a Mixed-fidelity Prototyping ApproachExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650994(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650994
Show More Cited By

Index Terms

TouchPivot: Blending WIMP & Post-WIMP Interfaces for Data Exploration on Tablet Devices
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Exploring information spaces by using tangible magic lenses in a tabletop environment
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

To solve the challenge of exploring large information spaces on interactive surfaces such as tabletops, we developed an optically tracked, lightweight, passive display (magic lens) that provides elegant three-dimensional exploration of rich datasets. ...
Demonstrating David Meets Goliath: Combining Smartwatches with a Large Vertical Display for Visual Data Exploration
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

We explore the combination of smartwatches and a large interactive display to support visual data analysis. These two extremes of interactive surfaces are increasingly popular, but feature different characteristics-display and input modalities, personal/...
Browsing Zoomable Treemaps: Structure-Aware Multi-Scale Navigation Techniques

Treemaps provide an interesting solution for representing hierarchical data. However, most studies have mainly focused on layout algorithms and paid limited attention to the interaction with treemaps. This makes it difficult to explore large data sets ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

May 2017

7138 pages

ISBN:9781450346559

DOI:10.1145/3025453

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Korea government(MSIP)

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

34
Total Citations
View Citations
782
Total Downloads

Downloads (Last 12 months)56
Downloads (Last 6 weeks)7

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

L’Yi Svan den Brandt AAdams ENguyen HGehlenborg N(2025)Learnable and Expressive Visualization Authoring Through Blended InterfacesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345659831:1(459-469)Online publication date: Jan-2025
https://doi.org/10.1109/TVCG.2024.3456598
van den Brandt AL'Yi SNguyen HVilanova AGehlenborg N(2025)Understanding Visualization Authoring Techniques for Genomics Data in the Context of Personas and TasksIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345629831:1(1180-1190)Online publication date: Jan-2025
https://doi.org/10.1109/TVCG.2024.3456298
Polidoro FLiu YCraig P(2024)Enhancing Mobile Visualisation Interactivity: Insights on a Mixed-fidelity Prototyping ApproachExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650994(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650994
Seraji MPiray PZahednejad VStuerzlinger W(2024)Analyzing User Behaviour Patterns in a Cross-Virtuality Immersive Analytics SystemIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337212930:5(2613-2623)Online publication date: May-2024
https://doi.org/10.1109/TVCG.2024.3372129
Zeng WChen XHou YShao LChu ZChang R(2024)Semi-Automatic Layout Adaptation for Responsive Multiple-View Visualization DesignIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324035630:7(3798-3812)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3240356
Cavez VAppert CPietriga E(2023)Spreadsheets on Interactive Surfaces: Breaking through the Grid with the PenACM Transactions on Computer-Human Interaction10.1145/363009731:2(1-33)Online publication date: 25-Oct-2023
https://dl.acm.org/doi/10.1145/3630097
Szentirmai AMurano P(2023)New Universal Design Heuristics for Mobile Augmented Reality ApplicationsHCI International 2023 – Late Breaking Papers10.1007/978-3-031-48041-6_27(404-418)Online publication date: 2-Dec-2023
https://doi.org/10.1007/978-3-031-48041-6_27
Molina León GLischka MLuo WBreiter A(2022)Mobile and Multimodal? A Comparative Evaluation of Interactive Workplaces for Visual Data ExplorationComputer Graphics Forum10.1111/cgf.1455141:3(417-428)Online publication date: 12-Aug-2022
https://doi.org/10.1111/cgf.14551
Johnson DDragojlovic NKopac NChen YLenzen MLe Huray SPollard SRegier DHarrison MGeorge ACarenini GNg RLynd L(2022)EXPECT-NLP: An Integrated Pipeline and User Interface for Exploring Patient Preferences Directly from Patient-Generated TextMultimodal AI in Healthcare10.1007/978-3-031-14771-5_6(77-89)Online publication date: 29-Nov-2022
https://doi.org/10.1007/978-3-031-14771-5_6
Langner RSatkowski MBüschel WDachselt RKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data AnalysisProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445593(1-17)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445593
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents