Cited By
View all- Cromley JMirabelli JKunze A(2024)Three applications of semantic network analysis to individual student think-aloud dataContemporary Educational Psychology10.1016/j.cedpsych.2024.10231879(102318)Online publication date: Dec-2024
Construction and Analysis of Collaborative Educational Networks based on Student Concept Maps
Authors: 
Hayden Freedman, Neil Young, David Schaefer, Qingyu Song, André van der Hoek, 
Bill TomlinsonAuthors Info & Claims
Hayden Freedman, Neil Young, David Schaefer, Qingyu Song, André van der Hoek, Bill TomlinsonAuthors Info & ClaimsArticle No.: 36, Pages 1 - 22
Abstract
Network Analysis has traditionally been applied to analyzing interactions among learners in online learning platforms such as discussion boards. However, there are opportunities to bring Network Analysis to bear on networks representing learners' mental models of course material, rather than learner interactions. This paper describes the construction and analysis of collaborative educational networks based on concept maps created by undergraduates. Concept mapping activities were deployed throughout two separate quarters of a large General Education (GE) course about sustainability and technology at a large university on the West Coast of the United States. A variety of Network Analysis metrics are evaluated on their ability to predict an individual learner's understanding based on that learner's contributions to a network representing the collective understanding of all learners in the course. Several of the metrics significantly correlated with learner performance, especially those that compare an individual learner's conformity to the larger group's consensus. The novel network metrics based on collective networks of learner concept maps are shown to produce stronger and more reproducible correlations with learner performance than metrics traditionally used in the literature to evaluate concept maps. This paper thus demonstrates that Network Analysis in conjunction with collective networks of concept maps can provide insights into learners' conceptual understanding of course material.
References
[1]
Mark S Ackerman, Juri Dachtera, Volkmar Pipek, and Volker Wulf. 2013. Sharing knowledge and expertise: The CSCW view of knowledge management. Computer Supported Cooperative Work (CSCW) 22, 4 (2013), 531--573.
[2]
Gulgun Afacan Adanir. 2019. Detecting topics of chat discussions in a computer supported collaborative learning (CSCL) environment. Turkish Online Journal of Distance Education 20, 1 (2019), 96--114.
[3]
Nitin Agarwal and Faysal Ahmed. 2017. Developing collective learning extension for rapidly evolving information system courses. Education and Information Technologies 22, 1 (2017), 7--37.
[4]
Payam Aminpour, Steven A Gray, Antonie Jetter, and Philippe J Giabbanelli. 2018. Is the crowd wise enough to capture systems complexities? An exploration of wisdom of crowds using Fuzzy Cognitive Maps. (2018).
[5]
Mary Besterfield-Sacre, Jessica Gerchak, Mary Rose Lyons, Larry J Shuman, and Harvey Wolfe. 2004. Scoring concept maps: An integrated rubric for assessing engineering education. Journal of Engineering Education 93, 2 (2004), 105--115.
[6]
Gautam Biswas, Krittaya Leelawong, Daniel Schwartz, Nancy Vye, and The Teachable Agents Group at Vanderbilt. 2005. Learning by teaching: A new agent paradigm for educational software. Applied Artificial Intelligence 19, 3--4 (2005), 363--392.
[7]
Stephen P Borgatti, Ajay Mehra, Daniel J Brass, and Giuseppe Labianca. 2009. Network analysis in the social sciences. Science 323, 5916 (2009), 892--895.
[8]
Rita Cadima, Jordi Ojeda Rodríguez, and José María Monguet Fierro. 2012. Social networks and performance in distributed learning communities. Educational technology and society 15, 4 (2012), 296--304.
[9]
AJ Cañas, JD Novak, and FM González. 2004. Varieties of concept mapping. (2004).
[10]
Alberto J Cañas, Greg Hill, Roger Carff, Niranjan Suri, James Lott, Gloria Gómez, Thomas C Eskridge, Mario Arroyo, and Rodrigo Carvajal. 2004. CmapTools: A knowledge modeling and sharing environment. (2004).
[11]
Karina L Cela, Miguel Ángel Sicilia, and Salvador Sánchez. 2015. Social network analysis in e-learning environments: A preliminary systematic review. Educational Psychology Review 27, 1 (2015), 219--246.
[12]
Li-Chen Cheng and Hui-Chun Chu. 2019. An innovative consensus map-embedded collaborative learning system for ER diagram learning: Sequential analysis of students' learning achievements. Interactive Learning Environments 27, 3 (2019), 410--425.
[13]
Hichang Cho, Geri Gay, Barry Davidson, and Anthony Ingraffea. 2007. Social networks, communication styles, and learning performance in a CSCL community. Computers & education 49, 2 (2007), 309--329.
[14]
Laura H Clayton. 2006. Concept mapping: an effective, active teaching-learning method. Nursing education perspectives 27, 4 (2006), 197--203.
[15]
Simone CO Conceição and Linda D Taylor. 2007. Using a constructivist approach with online concept maps: Relationship between theory and nursing education. Nursing education perspectives 28, 5 (2007), 268--275.
[16]
Kalani Craig, Joshua Danish, Megan Humburg, Cindy Hmelo-Silver, Maksymilian Szostalo, and Ann McCranie. 2021. Net. Create: Network visualization to support collaborative historical knowledge building. International Journal of Computer-Supported Collaborative Learning 16, 2 (2021), 185--223.
[17]
Jingjing Cui and Shengquan Yu. 2019. Fostering deeper learning in a flipped classroom: Effects of knowledge graphs versus concept maps. British Journal of Educational Technology 50, 5 (2019), 2308--2328.
[18]
Marielle Dado and Daniel Bodemer. 2017. A review of methodological applications of social network analysis in computer-supported collaborative learning. Educational Research Review 22 (2017), 159--180.
[19]
Harry S Delugach, Letha H Etzkorn, Sandra Carpenter, and Dawn Utley. 2016. A knowledge capture approach for directly acquiring team mental models. International Journal of Human-Computer Studies 96 (2016), 12--21.
[20]
Jana Dlouhá and Simon Burandt. 2015. Design and evaluation of learning processes in an international sustainability oriented study programme. In search of a new educational quality and assessment method. Journal of Cleaner Production 106 (2015), 247--258.
[21]
Katherine Dunsmore, Jennifer Turns, and Jessica M Yellin. 2011. Looking toward the real world: Student conceptions of engineering. Journal of Engineering Education 100, 2 (2011), 329--348.
[22]
Tanja Engelmann and Friedrich W Hesse. 2010. How digital concept maps about the collaborators' knowledge and information influence computer-supported collaborative problem solving. International Journal of Computer-Supported Collaborative Learning 5, 3 (2010), 299--319.
[23]
Ernesto Estrada and Naomichi Hatano. 2008. Communicability in complex networks. Physical Review E 77, 3 (2008), 036111.
[24]
Mohammadreza Farrokhnia, Héctor J Pijeira-Díaz, Omid Noroozi, and Javad Hatami. 2019. Computer-supported collaborative concept mapping: The effects of different instructional designs on conceptual understanding and knowledge co-construction. Computers & Education 142 (2019), 103640.
[25]
Albert Fornells, Zaida Rodrigo, Xari Rovira, Mónica Sánchez, Ricard Santomà, Francesc Teixidó-Navarro, and Elisabet Golobardes. 2015. Promoting consensus in the concept mapping methodology: an application in the hospitality sector. Pattern Recognition Letters 67 (2015), 39--48.
[26]
Hayden Freedman, André van der Hoek, and Bill Tomlinson. 2022. Improving Wikidata with Student-Generated Concept Maps. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 16. 205--215.
[27]
Hong Gao, E Shen, Susan Losh, and Jeannine Turner. 2007. A review of studies on collaborative concept mapping: What have we learned about the technique and what is next? Journal of Interactive Learning Research 18, 4 (2007), 479--492.
[28]
Hannie Gijlers, Nadira Saab, Wouter R Van Joolingen, Ton De Jong, and Bernadette HAM Van Hout-Wolters. 2009. Interaction between tool and talk: how instruction and tools support consensus building in collaborative inquiry-learning environments. Journal of Computer Assisted Learning 25, 3 (2009), 252--267.
[29]
Alyssa W Goldman and Mary Kane. 2014. Concept mapping and network analysis: An analytic approach to measure ties among constructs. Evaluation and Program Planning 47 (2014), 9--17.
[30]
Wenge Guo and Joseph Romano. 2007. A generalized Sidak-Holm procedure and control of generalized error rates under independence. Statistical applications in genetics and molecular biology 6, 1 (2007).
[31]
Aric Hagberg, Pieter Swart, and Daniel S Chult. 2008. Exploring network structure, dynamics, and function using NetworkX. Technical Report. Los Alamos National Lab.(LANL), Los Alamos, NM (United States).
[32]
Caroline A Haythornthwaite. 1999. Networks of information sharing among computer-supported distance learners. (1999).
[33]
Cindy E Hmelo-Silver and Heisawn Jeong. 2021. An overview of CSCL methods. International Handbook of Computer- Supported Collaborative Learning (2021), 65--83.
[34]
Kathryn W Jablokow, Joanna F DeFranco, and Sally Sue Richmond. 2013. A statistical study of concept mapping metrics. In 2013 ASEE Annual Conference & Exposition. 23--105.
[35]
Jeonghyun Kim, Hyeyun Lee, Yesom Yoo, Hanall Sung, Il-Hyun Jo, and Yeonjeong Park. 2015. Towards Smart Asynchronous Discussion Activity: Using Social Network Analysis to Investigate Students' Discussion Patterns. In Emerging issues in smart learning. Springer, 361--370.
[36]
Ian M Kinchin, David B Hay, and Alan Adams. 2000. How a qualitative approach to concept map analysis can be used to aid learning by illustrating patterns of conceptual development. Educational research 42, 1 (2000), 43--57.
[37]
Vassilis Komis, Nikolaos Avouris, and Christos Fidas. 2002. Computer-supported collaborative concept mapping: Study of synchronous peer interaction. Education and Information Technologies 7 (2002), 169--188.
[38]
Ismo T Koponen and Maija Nousiainen. 2019. Pre-service teachers' knowledge of relational structure of physics concepts: finding key concepts of electricity and magnetism. Education Sciences 9, 1 (2019), 18.
[39]
Maarten De Laat, Vic Lally, Lasse Lipponen, and Robert-Jan Simons. 2007. Online teaching in networked learning communities: A multi-method approach to studying the role of the teacher. Instructional Science 35, 3 (2007), 257--286.
[40]
Peter Lampert, Martin Scheuch, Peter Pany, Bernhard Müllner, and Michael Kiehn. 2019. Understanding students' conceptions of plant reproduction to better teach plant biology in schools. Plants, People, Planet 1, 3 (2019), 248--260.
[41]
Leigh Anne Liu, Ray Friedman, Bruce Barry, Michele J Gelfand, and Zhi-Xue Zhang. 2012. The dynamics of consensus building in intracultural and intercultural negotiations. Administrative Science Quarterly 57, 2 (2012), 269--304.
[42]
Sannyuya Liu, Lingyun Kang, Zhi Liu, Jing Fang, Zongkai Yang, Jianwen Sun, Meiyi Wang, and Mengwei Hu. 2021. Computer-supported collaborative concept mapping: the impact of students' perceptions of collaboration on their knowledge understanding and behavioral patterns. Interactive Learning Environments (2021), 1--20.
[43]
Kimberly Maguire Markham. 1992. The structure and use of biological knowledge about mammals in novice and experienced students. Ph. D. Dissertation. University of North Carolina at Wilmington.
[44]
Daniel McLinden. 2013. Concept maps as network data: Analysis of a concept map using the methods of social network analysis. Evaluation and program planning 36, 1 (2013), 40--48.
[45]
Brian Moon, C Johnston, and S Moon. 2018. A case for the superiority of concept mapping-based assessments for assessing mental models. In Concept Mapping: Renewing Learning and Thinking. Proceedings of the 8th Int. Conference on Concept Mapping, Medellín, Colombia: Universidad EAFIT.
[46]
Joseph D Novak. 1990. Concept mapping: A useful tool for science education. Journal of research in science teaching 27, 10 (1990), 937--949.
[47]
Kari A Nurmela, Erno Lehtinen, and Tuire Palonen. 1999. Evaluating CSCL log files by social network analysis. (1999).
[48]
Debra L O'Connor, Tristan E Johnson, and Mohammed K Khalil. 2004. Measuring team cognition: Concept mapping elicitation as a means of constructing team shared mental models in an applied setting. (2004).
[49]
Fan Ouyang. 2021. Using three social network analysis approaches to understand computer-supported collaborative learning. Journal of Educational Computing Research 59, 7 (2021), 1401--1424.
[50]
Claudia Picardi, Annamaria Goy, Daniele Gunetti, Giovanna Petrone, Marco Roberti, Nuninger Walter, et al. 2020. I learn. You learn. We learn? An experiment in collaborative concept mapping. In CSEDU 2020--12th International Conference on Computer Supported Education, Vol. 2. Scitepress, 15--25.
[51]
Goran Putnik, Eric Costa, Cátia Alves, Hélio Castro, Leonilde Varela, and Vaibhav Shah. 2016. Analysing the correlation between social network analysis measures and performance of students in social network-based engineering education. International Journal of Technology and Design Education 26, 3 (2016), 413--437.
[52]
Debbie Denise Reese. 2004. Assessment and concept map structure: The interaction between subscores and well-formed mental models. In meeting of the American Educational Research Association, San Diego.
[53]
Pablo Reyes and Pierre Tchounikine. 2017. Mining learning groups' activities in Forum-type tools. In Computer Supported Collaborative Learning 2005: The Next 10 Years! Routledge, 509--513.
[54]
Scott R Rosas. 2017. Group concept mapping methodology: toward an epistemology of group conceptualization, complexity, and emergence. Quality & quantity 51, 3 (2017), 1403--1416.
[55]
Mohammed Saqr and Sonsoles López-Pernas. 2022. How CSCL roles emerge, persist, transition, and evolve over time: A four-year longitudinal study. Computers & Education 189 (2022), 104581.
[56]
Mohammed Saqr, Olga Viberg, and Henriikka Vartiainen. 2020. Capturing the participation and social dimensions of computer-supported collaborative learning through social network analysis: which method and measures matter? International Journal of Computer-Supported Collaborative Learning 15, 2 (2020), 227--248.
[57]
Beat A Schwendimann. 2014. Making sense of knowledge integration maps. Digital knowledge maps in education: Technology-enhanced support for teachers and learners (2014), 17--40.
[58]
David Williamson Shaffer, David Hatfield, Gina Navoa Svarovsky, Padraig Nash, Aran Nulty, Elizabeth Bagley, Ken Frank, André A Rupp, and Robert Mislevy. 2009. Epistemic network analysis: A prototype for 21st-century assessment of learning. International Journal of Learning and Media 1, 2 (2009).
[59]
Cynthia SQ Siew. 2019. Using network science to analyze concept maps of psychology undergraduates. Applied Cognitive Psychology 33, 4 (2019), 662--668.
[60]
Cynthia SQ Siew. 2020. Applications of network science to education research: Quantifying knowledge and the development of expertise through network analysis. Education Sciences 10, 4 (2020), 101.
[61]
Cynthia SQ Siew, Dirk U Wulff, Nicole M Beckage, and Yoed N Kenett. 2019. Cognitive network science: A review of research on cognition through the lens of network representations, processes, and dynamics. Complexity 2019 (2019).
[62]
Tuya Siqin, Jan Van Aalst, and Samuel Kai Wah Chu. 2015. Fixed group and opportunistic collaboration in a CSCL environment. International Journal of Computer-Supported Collaborative Learning 10, 2 (2015), 161--181.
[63]
Gerry Stahl. 2016. From intersubjectivity to group cognition. Computer Supported Cooperative Work (CSCW) 25, 4 (2016), 355--384.
[64]
Neli Stoyanova and Piet Kommers. 2001. Learning effectiveness of concept mapping in a computer supported collaborative problem solving design. In First European International Conference on Computer-Supported Collaborative Learning, Vol. 13.
[65]
Binod Sundararajan. 2010. Emergence of the most knowledgeable other (mko): Social network analysis of chat and bulletin board conversations in a CSCL system. Electronic Journal of e-Learning 8, 2 (2010), 191--208.
[66]
Stefan Trausan-Matu and James D Slotta. 2021. Artifact analysis. In International Handbook of Computer-Supported Collaborative Learning. Springer, 551--567.
[67]
Karthikeyan Umapathy. 2010. Requirements to support collaborative sensemaking. In CSCW CIS Workshop, Vol. 10.
[68]
Sigrun Vehling, Carmine Malfitano, Joanna Shnall, Sarah Watt, Tania Panday, Aubrey Chiu, Anne Rydall, Camilla Zimmermann, Sarah Hales, Gary Rodin, et al . 2017. A concept map of death-related anxieties in patients with advanced cancer. BMJ supportive & palliative care 7, 4 (2017), 427--434.
[69]
Nicola Walshe. 2008. Understanding students' conceptions of sustainability. Environmental Education Research 14, 5 (2008), 537--558.
[70]
Duncan J Watts and Steven H Strogatz. 1998. Collective dynamics of ?small-world' networks. Nature 393, 6684 (1998), 440--442.
[71]
Zihan Wei, Lei Ren, Chao Liu, Mi Cao, Qun Yang, and Yanchun Deng. 2020. The concept map of felt stigma in patient with epilepsy. Seizure 80 (2020), 138--142.
[72]
Yue Yin, Jim Vanides, Maria Araceli Ruiz-Primo, Carlos C Ayala, and Richard J Shavelson. 2005. Comparison of two concept-mapping techniques: Implications for scoring, interpretation, and use. Journal of Research in Science Teaching: The Official Journal of the National Association for Research in Science Teaching 42, 2 (2005), 166--184.
[73]
Qian Zhang, Qingtang Liu, Ni Zhang, and Linjing Wu. 2019. Social Network Analysis of Knowledge Construction in Computer-Supported Collaborative Learning. 399--402. https://doi.org/10.35745/ecei2019v2.102
[74]
Si Zhang, Qianqian Gao, Mengyu Sun, Zhihui Cai, Honghui Li, Yanling Tang, and Qingtang Liu. 2022. Understanding student teachers' collaborative problem solving: Insights from an epistemic network analysis (ENA). Computers & Education 183 (2022), 104485.
Index Terms
- Construction and Analysis of Collaborative Educational Networks based on Student Concept Maps
Recommendations
Applying Concept Mapping on the Influent Learning in Virtual Classroom
HIS '09: Proceedings of the 2009 Ninth International Conference on Hybrid Intelligent Systems - Volume 01The diversity of learning abilities between learners in the virtual classroom is wider than those in traditional classroom. It is difficult to prepare a suitable teaching material for the needs of all learners in virtual classroom. Particularly, for ...
Learning how to use a computer-based concept-mapping tool: Self-explaining examples helps
In initial skill acquisition in well-structured domains, example-based learning typically leads to better learning outcomes than learning by doing. Cognitive Load Theory explains this result by the worked-example effect: Example-based learning prevents ...
Write-and-learn: promoting meaningful learning through concept map-based formative feedback on writing assignments
LAK '17: Proceedings of the Seventh International Learning Analytics & Knowledge ConferenceA primary goal of higher education is to promote meaningful learning: the delivery of core academic content to students in innovative ways that allow them to learn and then apply what they have learned. As a pedagogical strategy, Writing-to-Learn (WTL) ...
Comments
Information & Contributors
Information
Published In
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 26 April 2024
Published in PACMHCI Volume 8, Issue CSCW1
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- NSF
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 286Total Downloads
- Downloads (Last 12 months)286
- Downloads (Last 6 weeks)47
Reflects downloads up to 24 Dec 2024
Other Metrics
Citations
Cited By
View all- Cromley JMirabelli JKunze A(2024)Three applications of semantic network analysis to individual student think-aloud dataContemporary Educational Psychology10.1016/j.cedpsych.2024.10231879(102318)Online publication date: Dec-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in