QuickRef: Should I Read Cited Papers for Understanding This Paper?
Article No.: 240, Pages 1 - 7
Editorial Notes
The authors have requested minor, non-substantive changes to the VoR and, in accordance with ACM policies, a Corrected VoR was published on July 13, 2023. For reference purposes the VoR may still be accessed via the Supplemental Material section on this page.
Abstract
Researchers spend lots of time for reading scientific papers as they need to stay updated with recent trends. However, navigating citations, which are indispensable elements of research papers, can act as a barrier for junior researchers as they do not have enough background knowledge and experience. We conduct a formative user study to identify challenges in navigating cited papers. We then prototype QuickRef, an interactive reader that provides additional information about cited papers on the side panel. A preliminary user study documents the usability of QuickRef. Further, we present practical design implications for citation navigation support.
Supplementary Material
Version of Record for "QuickRef: Should I Read Cited Papers for Understanding This Paper?" by Park et al., Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems (CHI EA '23).
- Download
- 4.26 MB
Video Preview
- Download
- 10.48 MB
Pre-recorded Video Presentation
- Download
- 77.62 MB
References
[1]
Annette Adler, Anuj Gujar, Beverly L. Harrison, Kenton O’Hara, and Abigail Sellen. 1998. A Diary Study of Work-Related Reading: Design Implications for Digital Reading Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Los Angeles, California, USA) (CHI ’98). ACM Press/Addison-Wesley Publishing Co., USA, 241–248. https://doi.org/10.1145/274644.274679
[2]
Apache. 2023. PDF.js. https://mozilla.github.io/pdf.js/, Last accessed on 2023-01-17.
[3]
Akito Arita, Hiroaki Sugiyama, Kohji Dohsaka, Rikuto Tanaka, and Hirotoshi Taira. 2022. Citation Sentence Generation Leveraging the Content of Cited Papers. In Proceedings of the Third Workshop on Scholarly Document Processing. Association for Computational Linguistics, Gyeongju, Republic of Korea, 170–174. https://aclanthology.org/2022.sdp-1.19
[4]
Susanne Askwall. 1985. Computer supported reading vs reading text on paper: a comparison of two reading situations. International Journal of Man-Machine Studies 22, 4 (1985), 425–439. https://doi.org/10.1016/S0020-7373(85)80048-1
[5]
CHARLES BAZERMAN. 1985. Physicists Reading Physics: Schema-Laden Purposes and Purpose-Laden Schema. Written Communication 2, 1 (1985), 3–23. https://doi.org/10.1177/0741088385002001001 arXiv:https://doi.org/10.1177/0741088385002001001
[6]
Iz Beltagy, Kyle Lo, and Arman Cohan. 2019. SciBERT: A Pretrained Language Model for Scientific Text. CoRR abs/1903.10676 (Nov. 2019), 3615–3620. https://doi.org/10.18653/v1/D19-1371
[7]
Arthur Brack, Jennifer D’Souza, Anett Hoppe, Sören Auer, and Ralph Ewerth. 2020. Domain-independent Extraction of Scientific Concepts from Research Articles. CoRR abs/2001.03067 (2020), 251–266. arXiv:2001.03067http://arxiv.org/abs/2001.03067
[8]
Xiaoyan Cai, Sen Liu, Libin Yang, Yan Lu, Jintao Zhao, Dinggang Shen, and Tianming Liu. 2022. COVIDSum: A linguistically enriched SciBERT-based summarization model for COVID-19 scientific papers. Journal of Biomedical Informatics 127 (2022), 103999. https://doi.org/10.1016/j.jbi.2022.103999
[9]
Elsevier. 2023. Elsevier. Example document; https://www.sciencedirect.com/science/article/pii/S0740818807000692, Last accessed on 2023-01-17.
[10]
Esra Gündoğan and Mehmet Kaya. 2022. A Novel Hybrid Paper Recommendation System Using Deep Learning. Scientometrics 127, 7 (jul 2022), 3837–3855. https://doi.org/10.1007/s11192-022-04420-8
[11]
Hebatallah A. Mohamed Hassan. 2017. Personalized Research Paper Recommendation Using Deep Learning. In Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization (Bratislava, Slovakia) (UMAP ’17). Association for Computing Machinery, New York, NY, USA, 327–330. https://doi.org/10.1145/3079628.3079708
[12]
Andrew Head, Kyle Lo, Dongyeop Kang, Raymond Fok, Sam Skjonsberg, Daniel S. Weld, and Marti A. Hearst. 2021. Augmenting Scientific Papers with Just-in-Time, Position-Sensitive Definitions of Terms and Symbols. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 413, 18 pages. https://doi.org/10.1145/3411764.3445648
[13]
Andrew Head, Amber Xie, and Marti A. Hearst. 2022. Math Augmentation: How Authors Enhance the Readability of Formulas Using Novel Visual Design Practices. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 491, 18 pages. https://doi.org/10.1145/3491102.3501932
[14]
Hospice Houngbo and Robert E. Mercer. 2012. Method Mention Extraction from Scientific Research Papers. In Proceedings of COLING 2012. The COLING 2012 Organizing Committee, Mumbai, India, 1211–1222. https://aclanthology.org/C12-1074
[15]
Rajiv S Jhangiani, I-Chant A Chiang, Carrie Cuttler, Dana C Leighton, 2019. Research methods in psychology. Kwantlen Polytechnic University, 2666 72 Ave, Surrey, BC V3W 2M8 Canada.
[16]
Marcin Kardas, Piotr Czapla, Pontus Stenetorp, Sebastian Ruder, Sebastian Riedel, Ross Taylor, and Robert Stojnic. 2020. AxCell: Automatic Extraction of Results from Machine Learning Papers. CoRR abs/2004.14356 (2020), 8580–8594. arXiv:2004.14356https://arxiv.org/abs/2004.14356
[17]
Dae Hyun Kim, Enamul Hoque, Juho Kim, and Maneesh Agrawala. 2018. Facilitating Document Reading by Linking Text and Tables. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin, Germany) (UIST ’18). Association for Computing Machinery, New York, NY, USA, 423–434. https://doi.org/10.1145/3242587.3242617
[18]
Daniel King, Doug Downey, and Daniel S. Weld. 2020. High-Precision Extraction of Emerging Concepts from Scientific Literature. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (Virtual Event, China) (SIGIR ’20). Association for Computing Machinery, New York, NY, USA, 1549–1552. https://doi.org/10.1145/3397271.3401235
[19]
Minji Kwon, Jihyun Lee, Wanhae Lee, and Hyunggu Jung. 2020. BYE-TAL: Designing a Smartphone App for Sustainable Self-Healthcare through Design Thinking Process. In Proceedings of the 2020 Symposium on Emerging Research from Asia and on Asian Contexts and Cultures (Honolulu, HI, USA) (AsianCHI ’20). Association for Computing Machinery, New York, NY, USA, 9–12. https://doi.org/10.1145/3391203.3391204
[20]
Xiaozhong Liu, Zhuoren Jiang, and Liangcai Gao. 2015. Scientific Information Understanding via Open Educational Resources (OER). In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (Santiago, Chile) (SIGIR ’15). Association for Computing Machinery, New York, NY, USA, 645–654. https://doi.org/10.1145/2766462.2767750
[21]
David Nicholas, Peter Williams, Ian Rowlands, and Hamid R. Jamali. 2010. Researchers’ e-journal use and information seeking behaviour. Journal of Information Science 36, 4 (2010), 494–516. https://doi.org/10.1177/0165551510371883 arXiv:https://doi.org/10.1177/0165551510371883
[22]
Milda Norkute, Nadja Herger, Leszek Michalak, Andrew Mulder, and Sally Gao. 2021. Towards Explainable AI: Assessing the Usefulness and Impact of Added Explainability Features in Legal Document Summarization. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 53, 7 pages. https://doi.org/10.1145/3411763.3443441
[23]
Papers. 2023. Papers. https://www.papersapp.com/, Last accessed on 2023-01-17.
[24]
Antoine Ponsard, Francisco Escalona, and Tamara Munzner. 2016. PaperQuest: A Visualization Tool to Support Literature Review. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (San Jose, California, USA) (CHI EA ’16). Association for Computing Machinery, New York, NY, USA, 2264–2271. https://doi.org/10.1145/2851581.2892334
[25]
Brett Powley, Robert Dale, and Ilya Anisimoff. 2009. Enriching a document collection by integrating information extraction and PDF annotation. In Document Recognition and Retrieval XVI, Kathrin Berkner and Laurence Likforman-Sulem (Eds.). Vol. 7247. International Society for Optics and Photonics, SPIE, San Jose, California, United States, 724707. https://doi.org/10.1117/12.805548
[26]
. 2023. Example document; https:// .ncbi.nlm.nih.gov/35126506/, Last accessed on 2023-01-17.
[27]
SAGE. 2023. SAGE. Example document; https://journals.sagepub.com/doi/10.1177/24723444221132309, Last accessed on 2023-01-18.
[28]
Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. https://doi.org/10.48550/ARXIV.1910.01108
[29]
Mary D. Shepherd and Carla C. van de Sande. 2014. Reading mathematics for understanding—From novice to expert. The Journal of Mathematical Behavior 35 (2014), 74–86. https://doi.org/10.1016/j.jmathb.2014.06.003
[30]
Springer. 2023. Springer. Example document; https://link.springer.com/article/10.1007/s41095-022-0277-5, Last accessed on 2023-01-17.
[31]
Craig S. Tashman and W. Keith Edwards. 2011. Active Reading and Its Discontents: The Situations, Problems and Ideas of Readers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Vancouver, BC, Canada) (CHI ’11). Association for Computing Machinery, New York, NY, USA, 2927–2936. https://doi.org/10.1145/1978942.1979376
[32]
Carol Tenopir, Donald King, Sheri Edwards, and Lei Wu. 2009. Electronic Journals and Changes in Scholarly Article Seeking and Reading Patterns. Carol Tenopir 61 (01 2009). https://doi.org/10.1045/november2008-tenopir
[33]
Mingyang Wang, Jiaqi Zhang, Shijia Jiao, and Tianyu Zhang. 2019. Evaluating the impact of citations of articles based on knowledge flow patterns hidden in the citations. PLOS ONE 14, 11 (11 2019), 1–19. https://doi.org/10.1371/journal.pone.0225276
[34]
Xiaoguang Wang, Lingying Xia, and Qingyu Duan. 2022. The barriers and informational needs of students and junior researchers when reading scientific papers. Learned Publishing 35 (07 2022), 308–320. https://doi.org/10.1002/leap.1475
[35]
Chengzhi Zhang, Lei Zhao, Mengyuan Zhao, and Yingyi Zhang. 2022. Enhancing Keyphrase Extraction from Academic Articles with Their Reference Information. Scientometrics 127, 2 (feb 2022), 703–731. https://doi.org/10.1007/s11192-021-04230-4
[36]
Xiaolong Zhang, Yan Qu, C. Lee Giles, and Piyou Song. 2008. CiteSense: Supporting Sensemaking of Research Literature. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI ’08). Association for Computing Machinery, New York, NY, USA, 677–680. https://doi.org/10.1145/1357054.1357161
Index Terms
- QuickRef: Should I Read Cited Papers for Understanding This Paper?
Recommendations
An approach to estimating cited sentences in academic papers using Doc2vec
MEDES '18: Proceedings of the 10th International Conference on Management of Digital EcoSystemsMost academic authors refer to the literature when introducing their proposed methods and the data used in their experiments. These references can be very helpful when trying to understand a paper; however, some authors do not always state clearly the ...
Altmetrics analysis of highly cited academic papers in the field of library and information science
AbstractIn this study, altmetrics for LIS research papers, and whether OA affects the altmetrics, were analyzed. In addition, by analyzing the differences in the altmetrics in 10 major research areas of LIS, this study identified sub-research topics that ...
Highly cited papers in Library and Information Science LIS: Authors, institutions, and network structures
As a follow-up to the highly cited authors list published by Thomson Reuters in June 2014, we analyzed the top 1% most frequently cited papers published between 2002 and 2012 included in the Web of Science WoS subject category "Information Science & ...
Comments
Information & Contributors
Information
Published In
April 2023
3914 pages
ISBN:9781450394222
DOI:10.1145/3544549
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 April 2023
Check for updates
Author Tags
Qualifiers
- Work in progress
- Research
- Refereed limited
Funding Sources
Conference
CHI '23
Sponsor:
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 276Total Downloads
- Downloads (Last 12 months)118
- Downloads (Last 6 weeks)10
Reflects downloads up to 01 Jan 2025
Other Metrics
Citations
Cited By
View allView Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format