research-article

VIStory: Interactive Storyboard for Exploring Visual Information in Scientific Publications

Authors:

Zhanglin ChengAuthors Info & Claims

VINCI '19: Proceedings of the 12th International Symposium on Visual Information Communication and Interaction

Article No.: 12, Pages 1 - 8

https://doi.org/10.1145/3356422.3356430

Published: 20 September 2019 Publication History

Abstract

Many visual analytics have been developed for examining scientific publications comprising wealthy data such as authors and citations. The studies provide unprecedented insights on a variety of applications, e.g., literature review and collaboration analysis. However, visual information (i.e., figures) that are widely employed for storytelling and methods description are often neglected. We present VIStory, an interactive storyboard for exploring visual information in scientific publications. We harvest the data using an automatic figure extraction method, resulting in a large corpora of figures. Each figure contains various attributes such as dominant color and width/height ratio, together with faceted metadata of the publication including venues, authors, and keywords. To depict these information, we develop an intuitive interface consisting of three components: 1) Faceted View enables efficient query by publication metadata, benefiting from a nested table structure, 2) Storyboard View arranges paper rings -- a well-designed glyph for depicting figure attributes, in a themeriver layout to reveal temporal trends, and 3) Endgame View presents a highlighted figure together with the publication metadata. The system is especially useful for scientific publications containing substantial visual information, such as the visualization publications. We demonstrate the effectiveness of our approach using two case studies conducted on past ten-year IEEE VIS publications in 2009 - 2018.

References

[1]

M. A. Borkin, Z. Bylinskii, N. W. Kim, C. M. Bainbridge, C. S. Yeh, D. Borkin, H. Pfister, and A. Oliva. 2016. Beyond Memorability: Visualization Recognition and Recall. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2016), 519--528. https://doi.org/10.1109/TVCG.2015.2467732

Digital Library

[2]

M. A. Borkin, A. A. Vo, Z. Bylinskii, P. Isola, S. Sunkavalli, A. Oliva, and H. Pfister. 2013. What Makes a Visualization Memorable? IEEE Transactions on Visualization and Computer Graphics 19, 12 (2013), 2306--2315. https://doi.org/10.1109/TVCG. 2013.234

Digital Library

[3]

M. Chen, D. Ebert, H. Hagen, R. S. Laramee, R. van Liere, K. L. Ma, W. Ribarsky, G. Scheuermann, and D. Silver. 2009. Data, Information, and Knowledge in Visualization. IEEE Computer Graphics and Applications 29, 1 (2009), 12--19. https://doi.org/10.1109/MCG.2009.6

[4]

J.K. Chou and C. K. Yang. 2011. PaperVis: Literature Review Made Easy. Computer Graphics Forum 30, 3 (2011), 721-730. https://doi.org/10.1111/j.1467-8659.2011.01921.x

Digital Library

[5]

P. van der Corput and J. J. van Wijk. 2016. ICLIC: Interactive categorization of large image collections. In Proceedings of IEEE Pacific Visualization Symposium (PacificVis). 152--159. https://doi.org/10.1109/PACIFICVIS.2016.7465263

[6]

Danilo M. Eler, Marcel Y. Nakazaki, Fernando V. Paulovich, Davi P. Santos, Gabriel F. Andery, Maria Cristina F. Oliveira, João Batista Neto, and Rosane Minghim. 2009. Visual analysis of image collections. The Visual Computer 25, 10 (2009), 923-937. https://doi.org/10.1007/s00371-009-0368-7

Digital Library

[7]

P. Federico, F. Heimerl, S. Koch, and S. Miksch. 2017. A Survey on Visual Approaches for Analyzing Scientific Literature and Patents. IEEE Transactions on Visualization and Computer Graphics 23, 9 (2017), 2179--2198. https://doi.org/10.1109/TVCG.2016.2610422

Digital Library

[8]

Susan Havre, Beth Hetzler, and Lucy Nowell. 2000. ThemeRiver: Visualizing theme changes over time. In Proceedings of IEEE Symposium on Information Visualization. 115--123. https://doi.org/10.1109/INFVIS.2000.885098

[9]

I. T. Hawryszkiewycz. 1984. Database analysis and design. Science Research Associates.

[10]

Paul Heckbert. 1982. Color Image Quantization for Frame Buffer Display. SIG GRAPH Comput. Graph. 16, 3 (1982), 297--307. https://doi.org/10.1145/965145.801294

Digital Library

[11]

F. Heimerl, Q. Han, S. Koch, and T. Ertl. 2016. CiteRivers: Visual Analytics of Citation Patterns. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2016), 190--199. https://doi.org/10.1109/TVCG.2015.2467621

Digital Library

[12]

P. Isenberg, F. Heimerl, S. Koch, T. Isenberg, P. Xu, C. D. Stolper, M. Sedlmair, J. Chen, T. Möller, and J. Stasko. 2017. Vispubdata.org: A Metadata Collection About IEEE Visualization (VIS) Publications. IEEE Transactions on Visualization and Computer Graphics 23, 9 (2017), 2199--2206. https://doi.org/10.1109/TVCG.2016.2615308

Digital Library

[13]

P. Isenberg, T. Isenberg, M. Sedlmair, J. Chen, and T. Möller. 2017. Visualization as Seen through its Research Paper Keywords. IEEE Transactions on Visualization and Computer Graphics 23, 1 (2017), 771--780. https://doi.org/10.1109/TVCG.2016.2598827

Digital Library

[14]

H. Jänicke and M. Chen. 2010. A Salience-based Quality Metric for Visualization. Computer Graphics Forum 29, 3 (2010), 1183-1192. https://doi.org/10.1111/j.1467-8659.2009.01667.x

Digital Library

[15]

P. Joia, D. Coimbra, J. A. Cuminato, F. V. Paulovich, and L. G. Nonato. 2011. Local Affine Multidimensional Projection. IEEE Transactions on Visualization and Computer Graphics 17, 12 (2011), 2563--2571. https://doi.org/10.1109/TVCG.2011.220

Digital Library

[16]

Daniel Keim, Gennady Andrienko, Jean-Daniel Fekete, Carsten Görg, Jörn Kohlhammer, and Guy Melançon. 2008. Visual Analytics: Definition, Process, and Challenges. Lecture Notes in Computer Science, Vol. 4950. Springer Berlin Heidelberg, 154--175.

[17]

K. Kucher and A. Kerren. 2015. Text visualization techniques: Taxonomy, visual survey, and community insights. In Proceedings of IEEE Pacific Visualization Symposium (PacificVis). 117--121. https://doi.org/10.1109/PACIFICVIS.2015.7156366

[18]

S. Latif and F. Beck. 2018. VIS Author Profiles: Interactive Descriptions of Publication Records Combining Text and Visualization. IEEE Transactions on Visualization and Computer Graphics (2018), 1--1. https://doi.org/10.1109/TVCG.2018.2865022

Digital Library

[19]

Y. Liang, X. Wang, S. Zhang, S. Hu, and S. Liu. 2018. PhotoRecomposer: Interactive Photo Recomposition by Cropping. IEEE Transactions on Visualization and Computer Graphics 24, 10 (2018), 2728--2742. https://doi.org/10.1109/TVCG.2017.2764895

Digital Library

[20]

J. Marino and A. Kaufman. 2016. Planar Visualization of Treelike Structures. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2016), 906--915. https://doi.org/10.1109/TVCG.2015.2467413

Digital Library

[21]

L. E. Matzen, M. J. Haass, K. M. Divis, Z. Wang, and A. T. Wilson. 2018. Data Visualization Saliency Model: A Tool for Evaluating Abstract Data Visualizations. IEEE Transactions on Visualization and Computer Graphics 24, 1 (2018), 563--573. https://doi.org/10.1109/TVCG.2017.2743939

[22]

William Plant and Gerald Schaefer. 2011. Visualisation and Browsing of Image Databases. Springer Berlin Heidelberg, Berlin, Heidelberg, 3-57. https://doi.org/10.1007/978-3-642-19551-8_1

[23]

J. F. Rodrigues, A. J. M. Traina, M. C. F. de Oliveira, and C. Traina. 2006. Reviewing Data Visualization: an Analytical Taxonomical Study. In Proceedings of Tenth International Conference on Information Visualisation. 713--720. https://doi.org/10.1109/IV.2006.94

Digital Library

[24]

H.J. Schulz. 2011. Treevis.net: A Tree Visualization Reference. IEEE Computer Graphics and Applications 31, 6 (2011), 11--15. https://doi.org/10.1109/MCG.2011.103

Digital Library

[25]

Qiaomu Shen, Wei Zeng, Yu Ye, Stefan Mueller Arisona, Simon Schubiger, Remo Burkhard, and Huamin Qu. 2018. StreetVizor: Visual Exploration of Human-Scale Urban Forms Based on Street Views. IEEE Transactions on Visualization and Computer Graphics 24, 1 (2018), 1004 - 1013. https://doi.org/10.1109/TVCG.2017.2744159

[26]

B Shneiderman. 1996. The eyes have it: a task by data type taxonomy for information visualizations. In Proceedings of IEEE Symposium on Visual Languages. IEEE, 336 - 343. https://doi.org/10.1109/VL.1996.545307

[27]

H. Strobelt, D. Oelke, C. Rohrdantz, A. Stoffel, D. A. Keim, and O. Deussen. 2009. Document Cards: A Top Trumps Visualization for Documents. IEEE Transactions on Visualization and Computer Graphics 15, 6 (2009), 1145--1152. https://doi.org/10.1109/TVCG.2009.139

Digital Library

[28]

L. Tan, Y. Song, S. Liu, and L. Xie. 2012. ImageHive: Interactive Content-Aware Image Summarization. IEEE Computer Graphics and Applications 32, 1 (2012), 46--55. https://doi.org/10.1109/MCG.2011.89

Digital Library

[29]

Paul van der Corput and Jarke J. van Wijk. 2017. Comparing Personal Image Collections with PICTuReVis. Computer Graphics Forum 36, 3 (2017), 295--304. https://doi.org/10.1111/cgf.13188

Digital Library

[30]

Yanhong Wu, Naveen Pitipornvivat, Jian Zhao, Sixiao Yang, Guowei Huang, and Huamin Qu. 2015. egoSlider: Visual Analysis of Egocentric Network Evolution. IEEE Transactions on Visualization and Computer Graphics 22, 1 (2015), 260 - 269. https://doi.org/10.1109/TVCG.2015.2468151

Digital Library

[31]

X. Xie, X. Cai, J. Zhou, N. Cao, and Y. Wu. 2018. A Semantic-based Method for Visualizing Large Image Collections. IEEE Transactions on Visualization and Computer Graphics (2018), 1--1. https://doi.org/10.1109/TVCG.2018.2835485

[32]

J. Yang, J. Fan, D. Hubball, Y. Gao, H. Luo, W. Ribarsky, and M. Ward. 2006. Semantic Image Browser: Bridging Information Visualization with Automated Intelligent Image Analysis. In Proceedings of IEEE Symposium On Visual Analytics Science And Technology. 191--198. https://doi.org/10.1109/VAST.2006.261425

[33]

Ka-Ping Yee, Kirsten Swearingen, Kevin Li, and Marti Hearst. 2003. Faceted metadata for image search and browsing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 642681, 401--408. https://doi.org/10.1145/642611.642681

Digital Library

Cited By

Wang JYang ZCheng Z(2024)Deep Pre-Training Transformers for Scientific Paper RepresentationElectronics10.3390/electronics1311212313:11(2123)Online publication date: 29-May-2024
https://doi.org/10.3390/electronics13112123
Wang YQian YQi XCao NWang D(2024): A Visual Analytics Approach for Understanding the Dual Frontiers of Science and TechnologyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332738730:1(518-528)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3327387
Hariharan NDeepak G(2024)SSAT: Scientific Storyboarding Framework Using Artificial Intelligence TechniquesData Science and Security10.1007/978-981-97-0975-5_37(409-418)Online publication date: 31-May-2024
https://doi.org/10.1007/978-981-97-0975-5_37
Show More Cited By

Index Terms

VIStory: Interactive Storyboard for Exploring Visual Information in Scientific Publications
1. Human-centered computing
  1. Visualization
    1. Visualization systems and tools

Recommendations

VIStory: interactive storyboard for exploring visual information in scientific publications
Abstract
Many visual analytics have been developed for examining scientific publications comprising wealthy data such as authors and citations. The studies provide unprecedented insights on a variety of applications, e.g., literature review and ...
FacetMap: A Scalable Search and Browse Visualization

The dominant paradigm for searching and browsing large data stores is text-based: presenting a scrollable list of search results in response to textual search term input. While this works well for the Web, there is opportunity for improvement in the ...
Document visualization: an overview of current research

As the number of sources and quantity of document information explodes, efficient and intuitive visualization tools are desperately needed to assist users in understanding the contents and features of a document, while discovering hidden information. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

VINCI '19: Proceedings of the 12th International Symposium on Visual Information Communication and Interaction

September 2019

201 pages

ISBN:9781450376266

DOI:10.1145/3356422

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

East China Normal University

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 September 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

VINCI'2019

VINCI'2019: The 12th International Symposium on Visual Information Communication and Interaction

September 20 - 22, 2019

Shanghai, China

Acceptance Rates

Overall Acceptance Rate 71 of 193 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
257
Total Downloads

Downloads (Last 12 months)58
Downloads (Last 6 weeks)5

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wang JYang ZCheng Z(2024)Deep Pre-Training Transformers for Scientific Paper RepresentationElectronics10.3390/electronics1311212313:11(2123)Online publication date: 29-May-2024
https://doi.org/10.3390/electronics13112123
Wang YQian YQi XCao NWang D(2024): A Visual Analytics Approach for Understanding the Dual Frontiers of Science and TechnologyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332738730:1(518-528)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3327387
Hariharan NDeepak G(2024)SSAT: Scientific Storyboarding Framework Using Artificial Intelligence TechniquesData Science and Security10.1007/978-981-97-0975-5_37(409-418)Online publication date: 31-May-2024
https://doi.org/10.1007/978-981-97-0975-5_37
Chen YYe YZeng W(2023)The Rich, the Poor, and the Ugly: An Aesthetic-Perspective Assessment of NFT ValuesProceedings of the 16th International Symposium on Visual Information Communication and Interaction10.1145/3615522.3615545(1-8)Online publication date: 22-Sep-2023
https://dl.acm.org/doi/10.1145/3615522.3615545
Xia LGao YLin LChen YZhang K(2023)BiverWordle: Visualizing Stock Market Sentiment with Financial Text Data and TrendsProceedings of the 16th International Symposium on Visual Information Communication and Interaction10.1145/3615522.3615541(1-5)Online publication date: 22-Sep-2023
https://dl.acm.org/doi/10.1145/3615522.3615541
Dattolo ACorbatto MAngelini MBottoni PPanizzi E(2022)VisualBib(va): A Visual Analytics Platform for Authoring and Reviewing BibliographiesProceedings of the 2022 International Conference on Advanced Visual Interfaces10.1145/3531073.3534466(1-3)Online publication date: 6-Jun-2022
https://dl.acm.org/doi/10.1145/3531073.3534466
Dattolo ACorbatto MAngelini M(2022)Authoring and Reviewing Bibliographies: Design and Development of a Visual Analytics Online PlatformIEEE Access10.1109/ACCESS.2022.315302710(21631-21645)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3153027
Dattolo ACorbatto M(2021)Assisting researchers in bibliographic tasks: A new usable, real‐time tool for analyzing bibliographiesJournal of the Association for Information Science and Technology10.1002/asi.2457873:6(757-776)Online publication date: 3-Oct-2021
https://doi.org/10.1002/asi.24578
Sultanum NMurad CWigdor D(2020)Understanding and Supporting Academic Literature Review Workflows with LitSenseProceedings of the 2020 International Conference on Advanced Visual Interfaces10.1145/3399715.3399830(1-5)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3399715.3399830

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents