research-article

Exploring Visual Information Flows in Infographics

Authors:

Hanspeter Pfister,

Daniel Cohen-Or,

Hui HuangAuthors Info & Claims

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 12

https://doi.org/10.1145/3313831.3376263

Published: 23 April 2020 Publication History

Abstract

Infographics are engaging visual representations that tell an informative story using a fusion of data and graphical elements. The large variety of infographic design poses a challenge for their high-level analysis. We use the concept of Visual Information Flow (VIF), which is the underlying semantic structure that links graphical elements to convey the information and story to the user. To explore VIF, we collected a repository of over 13K infographics. We use a deep neural network to identify visual elements related to information, agnostic to their various artistic appearances. We construct the VIF by automatically chaining these visual elements together based on Gestalt principles. Using this analysis, we characterize the VIF design space by a taxonomy of 12 different design patterns. Exploring in a real-world infographic dataset, we discuss the design space and potentials of VIF in light of this taxonomy.

Supplementary Material

MP4 File (paper136vf.mp4)

Supplemental video

Download
20.14 MB

MP4 File (paper136pv.mp4)

Preview video

Download
6.55 MB

MP4 File (a136-lu-presentation.mp4)

Download
48.96 MB

References

[1]

Fereshteh Amini, Nathalie Henry Riche, Bongshin Lee, Andres Monroy-Hernandez, and Pourang Irani. 2017. Authoring data-driven videos with dataclips. IEEE transactions on visualization and computer graphics 23, 1 (2017), 501--510.

[2]

Benjamin Bach, Zezhong Wang, Matteo Farinella, Dave Murray-Rust, and Nathalie Henry Riche. 2018. Design Patterns for Data Comics. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, Article 38, 12 pages.

Digital Library

[3]

Scott Bateman, Regan L Mandryk, Carl Gutwin, Aaron Genest, David McDine, and Christopher Brooks. 2010. Useful junk?: the effects of visual embellishment on comprehension and memorability of charts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2573--2582.

Digital Library

[4]

Jacci Howard Bear. 2019. Find Out If Your Page Layout Is in Balance. https://www.lifewire.com/balance-in-design-1078231. (February 02 2019). Bear2019.

[5]

Michelle A Borkin, Azalea A Vo, Zoya Bylinskii, Phillip Isola, Shashank Sunkavalli, Aude Oliva, and Hanspeter Pfister. 2013. What makes a visualization memorable? IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2306--2315.

Digital Library

[6]

Steven Bradley. 2015. Design Principles: Compositional Flow And Rhythm. https://www.smashingmagazine.com/2015/04/designprinciples-compositional-flow-and-rhythm/. (April 29 2015). Bradley2015.

[7]

Jean M Brechman. 2010. Narrative "flow": A model of narrative processing and its impact on information processing, knowledge acquisition and persuasion. (2010).

[8]

M. Brehmer, B. Lee, B. Bach, N. H. Riche, and T. Munzner. 2017. Timelines Revisited: A Design Space and Considerations for Expressive Storytelling. IEEE Transactions on Visualization and Computer Graphics 23, 9 (Sep. 2017), 2151--2164.

Digital Library

[9]

Zoya Bylinskii, Sami Alsheikh, Spandan Madan, Adria Recasens, Kimberli Zhong, Hanspeter Pfister, Fredo Durand, and Aude Oliva. 2017a. Understanding infographics through textual and visual tag prediction. arXiv preprint arXiv:1709.09215 (2017).

[10]

Zoya Bylinskii, Nam Wook Kim, Peter O'Donovan, Sami Alsheikh, Spandan Madan, Hanspeter Pfister, Fredo Durand, Bryan Russell, and Aaron Hertzmann. 2017b. Learning visual importance for graphic designs and data visualizations. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, 57--69.

Digital Library

[11]

Zhutian Chen, Yun Wang, Qianwen Wang, Yong Wang, and Huamin Qu. 2019. Towards Automated Infographic Design: Deep Learning-based Auto-Extraction of Extensible Timeline. IEEE transactions on visualization and computer graphics 26, 1 (2019), 917--926.

[12]

Laurens Van Der Maaten and Geoffrey E Hinton. 2008. Visualizing Data using t-SNE. Journal of Machine Learning Research 9 (2008), 2579--2605.

[13]

Agné Desolneux, Lionel Moisan, and Jean-Michel Morel. 2004. Gestalt theory and computer vision. (2004), 71--101.

[14]

Martin Ester, Hans-Peter Kriegel, Jörg Sander, Xiaowei Xu, and others. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In Kdd, Vol. 96. 226--231.

Digital Library

[15]

Johanna Fulda, Matthew Brehmel, and Tamara Munzner. 2016. Timelinecurator: Interactive authoring of visual timelines from unstructured text. IEEE transactions on visualization and computer graphics 22, 1 (2016), 300--309.

[16]

Ross Girshick. 2015. Fast r-cnn. In Proceedings of the IEEE international conference on computer vision. 1440--1448.

Digital Library

[17]

Steve Haroz, Robert Kosara, and Steven L Franconeri. 2015. Isotype visualization: Working memory, performance, and engagement with pictographs. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, 1191--1200.

Digital Library

[18]

Lane Harrison, Katharina Reinecke, and Remco Chang. 2015. Infographic aesthetics: Designing for the first impression. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 1187--1190.

Digital Library

[19]

Jeffrey Heer and George Robertson. 2007. Animated transitions in statistical data graphics. IEEE transactions on visualization and computer graphics 13, 6 (2007), 1240--1247.

Digital Library

[20]

Weiyin Hong, James YL Thong, and Kar Yan Tam. 2004. Does animation attract online users' attention? The effects of flash on information search performance and perceptions. Information Systems Research 15, 1 (2004), 60--86.

Digital Library

[21]

Jessica Hullman, Steven Drucker, Nathalie Henry Riche, Bongshin Lee, Danyel Fisher, and Eytan Adar. 2013. A Deeper Understanding of Sequence in Narrative Visualization. IEEE Transactions on Visualization and Computer Graphics 19, 12 (Dec. 2013), 2406--2415.

Digital Library

[22]

Ian Jolliffe. 2011. Principal component analysis. In International encyclopedia of statistical science. Springer, 1094--1096.

[23]

Nam Wook Kim, Zoya Bylinskii, Michelle A Borkin, Krzysztof Z Gajos, Aude Oliva, Fredo Durand, and Hanspeter Pfister. 2017. BubbleView: an interface for crowdsourcing image importance maps and tracking visual attention. ACM Transactions on Computer-Human Interaction (TOCHI) 24, 5 (2017), 36.

Digital Library

[24]

Nam Wook Kim, Eston Schweickart, Zhicheng Liu, Mira Dontcheva, Wilmot Li, Jovan Popovic, and Hanspeter Pfister. 2016. Data-driven guides: Supporting expressive design for information graphics. IEEE transactions on visualization and computer graphics 23, 1 (2016), 491--500.

[25]

Ranjitha Kumar, Arvind Satyanarayan, Cesar Torres, Maxine Lim, Salman Ahmad, Scott R Klemmer, and Jerry O Talton. 2013. Webzeitgeist: design mining the web. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3083--3092.

Digital Library

[26]

Bongshin Lee, Rubaiat Habib Kazi, and Greg Smith. 2013. SketchStory: Telling more engaging stories with data through freeform sketching. IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2416--2425.

Digital Library

[27]

Thomas F Liu, Mark Craft, Jason Situ, Ersin Yumer, Radomir Mech, and Ranjitha Kumar. 2018a. Learning Design Semantics for Mobile Apps. In The 31st Annual ACM Symposium on User Interface Software and Technology. ACM, 569--579.

[28]

Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, and Alexander C Berg. 2016. Ssd: Single shot multibox detector. In European conference on computer vision. Springer, 21--37.

[29]

Zhicheng Liu, John Thompson, Alan Wilson, Mira Dontcheva, James Delorey, Sam Grigg, Bernard Kerr, and John Stasko. 2018b. Data Illustrator: Augmenting Vector Design Tools with Lazy Data Binding for Expressive Visualization Authoring. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, Article 123, 13 pages.

Digital Library

[30]

Sean McKenna, N Henry Riche, Bongshin Lee, Jeremy Boy, and M Meyer. 2017. Visual narrative flow: Exploring factors shaping data visualization story reading experiences. In Computer Graphics Forum, Vol. 36. Wiley Online Library, 377--387.

[31]

Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition. 779--788.

[32]

Babak Saleh, Mira Dontcheva, Aaron Hertzmann, and Zhicheng Liu. 2015. Learning Style Similarity for Searching Infographics. In Proceedings of the 41st Graphics Interface Conference (GI '15). 59--64.

Digital Library

[33]

Arvind Satyanarayan and Jeffrey Heer. 2014. Authoring Narrative Visualizations with Ellipsis. Computer Graphics Forum 33 (2014), 361--370.

[34]

Edward Segel and Jeffrey Heer. 2010. Narrative visualization: Telling stories with data. IEEE transactions on visualization and computer graphics 16, 6 (2010), 1139--1148.

Digital Library

[35]

Teo Siang. 2019. The Building Blocks of Visual Design. https://www.interaction-design.org/literature/article/thebuilding-blocks-of-visual-design. (March 2019).

[36]

Martin van den Berg, Michael Kubovy, and James A Schirillo. 2011. Grouping by regularity and the perception of illumination. Vision research 51, 12 (2011), 1360--1371.

[37]

Yun Wang, Haidong Zhang, He Huang, Xi Chen, Qiufeng Yin, Zhitao Hou, Dongmei Zhang, Qiong Luo, and Huamin Qu. 2018. InfoNice: Easy creation of information graphics. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 335.

Digital Library

[38]

Nanxuan Zhao, Ying Cao, and Rynson WH Lau. 2018. What characterizes personalities of graphic designs? ACM Transactions on Graphics (TOG) 37, 4 (2018), 116.

Digital Library

Cited By

Jeyaraman MJeyaraman NRamasubramanian SVaish AVaishya R(2024)Decoding Research with a Glance: The Power of Graphical Abstracts and InfographicsApollo Medicine10.1177/09760016241281426Online publication date: 13-Sep-2024
https://doi.org/10.1177/09760016241281426
Zhou THuang JChan G(2024)Epigraphics: Message-Driven Infographics AuthoringProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642172(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642172
Hao SWang ZBach BPschetz L(2024)Design Patterns for Data-Driven News ArticlesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641916(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641916
Show More Cited By

Index Terms

Exploring Visual Information Flows in Infographics
1. Human-centered computing
  1. Visualization
    1. Visualization design and evaluation methods

Recommendations

InfoNice: Easy Creation of Information Graphics
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Information graphics are widely used to convey messages and present insights in data effectively. However, creating expressive data-driven infographics remains a great challenge for general users without design expertise. We present InfoNice, a ...
A system for understanding imaged infographics and its applications
DocEng '07: Proceedings of the 2007 ACM symposium on Document engineering

Information graphics, or infographics, are visual representations of information, data or knowledge. Understanding of infographics in documents is a relatively new research problem, which becomes more challenging when infographics appear as raster ...
Enhancing Infographics Based on Symmetry Saliency
VINCI '16: Proceedings of the 9th International Symposium on Visual Information Communication and Interaction

Image saliency is a biologically inspired concept for characterizing visual conspicuity of individual features in natural images, and provides us with a useful insight into the mechanism for directing instant visual attention from viewers. Nevertheless, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

10688 pages

ISBN:9781450367080

DOI:10.1145/3313831

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China
Guangdong Provincial NSF
Shenzhen Innovation Program

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

39
Total Citations
View Citations
1,379
Total Downloads

Downloads (Last 12 months)233
Downloads (Last 6 weeks)13

Reflects downloads up to 14 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Jeyaraman MJeyaraman NRamasubramanian SVaish AVaishya R(2024)Decoding Research with a Glance: The Power of Graphical Abstracts and InfographicsApollo Medicine10.1177/09760016241281426Online publication date: 13-Sep-2024
https://doi.org/10.1177/09760016241281426
Zhou THuang JChan G(2024)Epigraphics: Message-Driven Infographics AuthoringProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642172(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642172
Hao SWang ZBach BPschetz L(2024)Design Patterns for Data-Driven News ArticlesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641916(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3641916
Zhu JHuang DWang CCheng MLi JHu HGeng XGuo B(2024)Unsupervised Graphic Layout Grouping with Transformers2024 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)10.1109/WACV57701.2024.00107(1020-1029)Online publication date: 3-Jan-2024
https://doi.org/10.1109/WACV57701.2024.00107
Chen QCao SWang JCao N(2024)How Does Automation Shape the Process of Narrative Visualization: A Survey of ToolsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.326132030:8(4429-4448)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3261320
Lin YLi HWu AWang YQu H(2024)DMiner: Dashboard Design Mining and RecommendationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.325134430:7(4108-4121)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3251344
Zeng WChen XHou YShao LChu ZChang R(2024)Semi-Automatic Layout Adaptation for Responsive Multiple-View Visualization DesignIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.324035630:7(3798-3812)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3240356
Lu JWang GCai YWu X(2024)Towards Automated Infographic Authoring From Natural Language Statement With Multiple Proportional FactsIEEE Transactions on Multimedia10.1109/TMM.2024.336072226(7101-7113)Online publication date: 2024
https://doi.org/10.1109/TMM.2024.3360722
Nuhoğlu Kibar P(2024)Infographic creation as an essential skill for highly visual Gen AlphaJournal of Visual Literacy10.1080/1051144X.2024.235084743:2(67-72)Online publication date: 9-May-2024
https://doi.org/10.1080/1051144X.2024.2350847
Ye YHao JHou YWang ZXiao SLuo YZeng W(2024)Generative AI for visualization: State of the art and future directionsVisual Informatics10.1016/j.visinf.2024.04.0038:2(43-66)Online publication date: Jun-2024
https://doi.org/10.1016/j.visinf.2024.04.003
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents