research-article

Open access

Adjacent Display of Relevant Discussion Helps Resolve Confusion

Authors:

Srishti Palani,

Scott KlemmerAuthors Info & Claims

Proceedings of the ACM on Human-Computer Interaction, Volume 5, Issue CSCW1

Article No.: 143, Pages 1 - 11

https://doi.org/10.1145/3449217

Published: 22 April 2021 Publication History

Abstract

Discussion fora of instructional videos contain previously-discussed questions and answers. These video comments can resolve many points of confusion for learners. However, finding relevant content in a separated discussion forum is challenging and disruptive to learning flow. This paper introduces Adjacent Display of Relevant Discussion (ADRD): it displays threaded comments in a panel adjacent to the video and dynamically updates the content of the panel based on the time of the video. In a between-subjects lab study (n=20), ADRD helped participants resolve confusion points, skim and read comments, and encouraged video interaction.

References

[1]

Akshay Agrawal, Jagadish Venkatraman, Shane Leonard, and Andreas Paepcke. 2015. YouEDU: addressing confusion in MOOC discussion forums by recommending instructional video clips. (2015).

[2]

Omaima Almatrafi and Aditya Johri. 2018. Systematic review of discussion forums in massive open online courses (MOOCs). IEEE Transactions on Learning Technologies, Vol. 12, 3 (2018), 413--428.

Digital Library

[3]

Thushari Atapattu and Katrina Falkner. 2016. A framework for topic generation and labeling from MOOC discussions. In Proceedings of the Third (2016) ACM Conference on Learning@ Scale. 201--204.

Digital Library

[4]

Christopher G Brinton, Mung Chiang, Shaili Jain, Henry Lam, Zhenming Liu, and Felix Ming Fai Wong. 2014. Learning about social learning in MOOCs: From statistical analysis to generative model. IEEE transactions on Learning Technologies, Vol. 7, 4 (2014), 346--359.

[5]

Michelene TH Chi. 2009. Active-constructive-interactive: A conceptual framework for differentiating learning activities. Topics in cognitive science, Vol. 1, 1 (2009), 73--105.

[6]

Henri G Colt, Mohsen Davoudi, Septimiu Murgu, and Nazanin Zamanian Rohani. 2011. Measuring learning gain during a one-day introductory bronchoscopy course. Surgical endoscopy, Vol. 25, 1 (2011), 207--216.

[7]

Yi Cui and Alyssa Friend Wise. 2015. Identifying content-related threads in MOOC discussion forums. In Proceedings of the Second (2015) ACM Conference on Learning@ Scale. 299--303.

Digital Library

[8]

Samuel Dodson, Ido Roll, Matthew Fong, Dongwook Yoon, Negar M Harandi, and Sidney Fels. 2018. An active viewing framework for video-based learning. In Proceedings of the Fifth Annual ACM Conference on Learning at Scale. 1--4.

Digital Library

[9]

Aysu Ezen-Can, Kristy Elizabeth Boyer, Shaun Kellogg, and Sherry Booth. 2015. Unsupervised modeling for understanding MOOC discussion forums: a learning analytics approach. In Proceedings of the fifth international conference on learning analytics and knowledge. 146--150.

Digital Library

[10]

Oliver Ferschke, Iris Howley, Gaurav Tomar, Diyi Yang, Yu Liu, and Carolyn Penstein Rosé. 2015. Fostering discussion across communication media in massive open online courses. International Society of the Learning Sciences, Inc.[ISLS].

[11]

Krzysztof Z Gajos, Juho Kim, Shang-Wen Li, Carrie J Cai, and Robert C Miller. 2014. Leveraging video interaction data and content analysis to improve video learning. (2014).

[12]

Philip J Guo, Juho Kim, and Rob Rubin. 2014. How video production affects student engagement: An empirical study of MOOC videos. In Proceedings of the first ACM conference on Learning@ scale conference. 41--50.

Digital Library

[13]

Negar M Harandi, Farshid Agharebparast, Luis Linares, Samuel Dodson, Ido Roll, Matthew Fong, Dongwook Yoon, and Sidney Fels. 2018. Student video-usage in introductory engineering courses. Proceedings of the Canadian Engineering Education Association (CEEA) (2018).

[14]

Kate S Hone and Ghada R El Said. 2016. Exploring the factors affecting MOOC retention: A survey study. Computers & Education, Vol. 98 (2016), 157--168.

Digital Library

[15]

Carol Hostetter. 2013. Community matters: Social presence and learning outcomes. Journal of the Scholarship of Teaching and Learning, Vol. 13, 1 (2013), 77--86.

[16]

Matthew B Hoy. 2014. MOOCs 101: an introduction to massive open online courses. Medical reference services quarterly, Vol. 33, 1 (2014), 85--91.

[17]

Jee Yeon Hwang, Pol Pla i Conesa, Henry Holtzman, and Marie-José Montpetit. 2012. CommenTV: A time-sensitive social commenting system for audiovisual content. In 2012 IEEE Consumer Communications and Networking Conference (CCNC). IEEE, 84--88.

[18]

Juho Kim, Philip J Guo, Carrie J Cai, Shang-Wen Li, Krzysztof Z Gajos, and Robert C Miller. 2014. Data-driven interaction techniques for improving navigation of educational videos. In Proceedings of the 27th annual ACM symposium on User interface software and technology. 563--572.

Digital Library

[19]

Jungjoo Kim, Yangyi Kwon, and Daeyeon Cho. 2011. Investigating factors that influence social presence and learning outcomes in distance higher education. Computers & Education, Vol. 57, 2 (2011), 1512--1520.

Digital Library

[20]

Chinmay Kulkarni, Koh Pang Wei, Huy Le, Daniel Chia, Kathryn Papadopoulos, Justin Cheng, Daphne Koller, and Scott R Klemmer. 2013. Peer and self assessment in massive online classes. ACM Transactions on Computer-Human Interaction (TOCHI), Vol. 20, 6 (2013), 1--31.

Digital Library

[21]

Rodrigo Laiola Guimar aes, Pablo Cesar, and Dick CA Bulterman. 2012. "Let me comment on your video" supporting personalized end-user comments within third-party online videos. In Proceedings of the 18th Brazilian symposium on Multimedia and the web. 253--260.

Digital Library

[22]

Reed W Larson and Maryse H Richards. 1991. Boredom in the middle school years: Blaming schools versus blaming students. American journal of education, Vol. 99, 4 (1991), 418--443.

[23]

Jean Lave, Etienne Wenger, et almbox. 1991. Situated learning: Legitimate peripheral participation. Cambridge university press.

[24]

Yunsup Lee, Rimas Avizienis, Alex Bishara, Richard Xia, Derek Lockhart, Christopher Batten, and Krste Asanović. 2011. Exploring the tradeoffs between programmability and efficiency in data-parallel accelerators. In Proceedings of the 38th annual international symposium on Computer architecture. 129--140.

Digital Library

[25]

Nan Li, Łukasz Kidziński, Patrick Jermann, and Pierre Dillenbourg. 2015. MOOC video interaction patterns: What do they tell us? In Design for teaching and learning in a networked world. Springer, 197--210.

[26]

Shu-Sheng Liaw. 2008. Investigating students' perceived satisfaction, behavioral intention, and effectiveness of e-learning: A case study of the Blackboard system. Computers & education, Vol. 51, 2 (2008), 864--873.

[27]

Xiaojuan Ma and Nan Cao. 2017. Video-based evanescent, anonymous, asynchronous social interaction: Motivation and adaption to medium. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. 770--782.

Digital Library

[28]

Jeffrey D Marx and Karen Cummings. 2007. Normalized change. American Journal of Physics, Vol. 75, 1 (2007), 87--91.

[29]

Naomi Miyake and Donald A Norman. 1979. To ask a question, one must know enough to know what is not known. Journal of verbal learning and verbal behavior, Vol. 18, 3 (1979), 357--364.

[30]

Pam Northrup. 2001. A framework for designing interactivity into web-based instruction. Educational technology, Vol. 41, 2 (2001), 31--39.

[31]

James D Pickering. 2017. Measuring learning gain: Comparing anatomy drawing screencasts and paper-based resources. Anatomical sciences education, Vol. 10, 4 (2017), 307--316.

[32]

Ido Roll and Philip H Winne. 2015. Understanding, evaluating, and supporting self-regulated learning using learning analytics. Journal of Learning Analytics, Vol. 2, 1 (2015), 7--12.

[33]

Lorenzo A Rossi and Omprakash Gnawali. 2014. Language independent analysis and classification of discussion threads in Coursera MOOC forums. In Proceedings of the 2014 IEEE 15th International Conference on Information Reuse and Integration (IEEE IRI 2014). IEEE, 654--661.

[34]

G Stahl, T Koschmann, and D Suthers. 2006. CSCL: An Historical Perspective on Computer-supported collaborative learning. Cambridge handbook of the learning sciences (2006), 409--426.

[35]

Angela Thomas. 2005. Children online: Learning in a virtual community of practice. E-Learning and Digital Media, Vol. 2, 1 (2005), 27--38.

[36]

Matthew JW Thomas. 2002. Learning within incoherent structures: The space of online discussion forums. Journal of Computer Assisted Learning, Vol. 18, 3 (2002), 351--366.

[37]

Nancy Wilson. 1989. Learning from confusion: Questions and change in reading logs. The English Journal, Vol. 78, 7 (1989), 62--69.

[38]

Alyssa Friend Wise, Yi Cui, Wanqi Jin, and Jovita Vytasek. 2017. Mining for gold: Identifying content-related MOOC discussion threads across domains through linguistic modeling. The Internet and Higher Education, Vol. 32 (2017), 11--28.

[39]

Qunfang Wu, Yisi Sang, and Yun Huang. 2019. Danmaku: A New Paradigm of Social Interaction via Online Videos. ACM Transactions on Social Computing, Vol. 2, 2 (2019), 1--24.

Digital Library

[40]

Qunfang Wu, Yisi Sang, Shan Zhang, and Yun Huang. 2018. Danmaku vs. forum comments: Understanding user participation and knowledge sharing in online videos. In Proceedings of the 2018 ACM Conference on Supporting Groupwork. 209--218.

Digital Library

[41]

Diyi Yang, Miaomiao Wen, Iris Howley, Robert Kraut, and Carolyn Rose. 2015. Exploring the effect of confusion in discussion forums of massive open online courses. In Proceedings of the second (2015) ACM conference on learning@ scale. 121--130.

Digital Library

[42]

Matin Yarmand, Dongwook Yoon, Samuel Dodson, Ido Roll, and Sidney S Fels. 2019. "Can you believe [1: 21]?!" Content and Time-Based Reference Patterns in Video Comments. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--12.

Digital Library

[43]

Dongsong Zhang, Lina Zhou, Robert O Briggs, and Jay F Nunamaker Jr. 2006. Instructional video in e-learning: Assessing the impact of interactive video on learning effectiveness. Information & management, Vol. 43, 1 (2006), 15--27.

[44]

Joyce Zhu, Jeremy Warner, Mitchell Gordon, Jeffery White, Renan Zanelatto, and Philip J Guo. 2015. Toward a domain-specific visual discussion forum for learning computer programming: An empirical study of a popular MOOC forum. In 2015 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, 101--109.

Cited By

Yarmand MChen CCheng KMurphy JWeibel N(2024)"I'd be watching him contour till 10 o'clock at night": Understanding Tensions between Teaching Methods and Learning Needs in Healthcare ApprenticeshipProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642453(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642453
Hardt R(2022)A System to Motivate Sustained Lecture Video Engagement in Small Private Online CoursesProceedings of the 22nd Koli Calling International Conference on Computing Education Research10.1145/3564721.3564735(1-12)Online publication date: 17-Nov-2022
https://dl.acm.org/doi/10.1145/3564721.3564735
Palani SZhou YZhu SDow S(2022)InterWeave: Presenting Search Suggestions in Context Scaffolds Information Search and SynthesisProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545696(1-16)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545696

Index Terms

Adjacent Display of Relevant Discussion Helps Resolve Confusion
1. Applied computing
  1. Education
    1. Interactive learning environments
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI
  2. Interaction design
    1. Empirical studies in interaction design

Recommendations

Untangling chaos in discussion forums: A temporal analysis of topic-relevant forum posts in MOOCs
Abstract
An effective experience in discussion forums is important for online learners to maintain their persistence in a MOOC. The purpose of this research is to identify learners’ meaningful participation patterns of topic-related forum posts ...
Highlights
- Classified topic-relevant forum posts in MOOCs using latent semantic analysis machine learning algorithm.
Voluntary participation in discussion forums as an engagement indicator: an empirical study of teaching first-year programming
OzCHI '16: Proceedings of the 28th Australian Conference on Computer-Human Interaction

Computer programming is a required skill for most STEM (Science, Technology, Engineering and Mathematics) students. However, teaching novices programming has long been considered a big challenge by computer science educators as manifested by the ...
Evaluation of a Massive Online Course Forum: Design Issues and Their Impact on Learners’ Support
Human-Computer Interaction – INTERACT 2019
Abstract
Massive Open Online Courses (MOOCs) are delivered through dedicated platforms that provide educational opportunities to a large number of learners around the globe. The discussion forum is a key part of a MOOC platform. Structured communication ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction

Proceedings of the ACM on Human-Computer Interaction Volume 5, Issue CSCW1

CSCW

April 2021

5016 pages

EISSN:2573-0142

DOI:10.1145/3460939

Editor:
Jeff Nichols
Apple Inc., United States

Issue’s Table of Contents

Copyright © 2021 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 April 2021

Published in PACMHCI Volume 5, Issue CSCW1

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
605
Total Downloads

Downloads (Last 12 months)162
Downloads (Last 6 weeks)17

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yarmand MChen CCheng KMurphy JWeibel N(2024)"I'd be watching him contour till 10 o'clock at night": Understanding Tensions between Teaching Methods and Learning Needs in Healthcare ApprenticeshipProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642453(1-19)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642453
Hardt R(2022)A System to Motivate Sustained Lecture Video Engagement in Small Private Online CoursesProceedings of the 22nd Koli Calling International Conference on Computing Education Research10.1145/3564721.3564735(1-12)Online publication date: 17-Nov-2022
https://dl.acm.org/doi/10.1145/3564721.3564735
Palani SZhou YZhu SDow S(2022)InterWeave: Presenting Search Suggestions in Context Scaffolds Information Search and SynthesisProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545696(1-16)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545696

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents