research-article

IneqDetect: A Visual Analytics System to Detect Conversational Inequality and Support Reflection during Active Learning

Authors:

Stephen MacNeil,

Brian Thompson,

Celine LatulipeAuthors Info & Claims

CompEd '19: Proceedings of the ACM Conference on Global Computing Education

Pages 85 - 91

https://doi.org/10.1145/3300115.3309528

Published: 09 May 2019 Publication History

Abstract

A series of recent studies have shed light on the existence of sociocultural inequities in collaborative learning environments. We present IneqDetect, a system which helps students reflect on the way that they communicate as a team. Conversations during collaborative learning activities are recorded using lapel microphones, processed to determine who spoke at a given time, and then visualized. The resulting dashboard visualization provides students with a timeline of when each student was speaking, a summary of how much they spoke, and an estimate of how equitable the conversation was between team members. Students reflect on this information at the end of the class period to identify and address issues, such as conversational inequality, within their groups. IneqDetect was deployed across four CS active learning classrooms. IneqDetect led students to discuss group dynamics, change their behaviors, and gain insights about themselves and their team. However, conversational equity within groups did not improve.

References

[1]

John Langshaw Austin. 1975. How to do things with words. Vol. 88. Oxford university press.

[2]

Madeline Balaam, Geraldine Fitzpatrick, Judith Good, and Rosemary Luckin. 2010. Exploring affective technologies for the classroom with the subtle stone. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1623--1632.

Digital Library

[3]

Tony Bergstrom and Karrie Karahalios. 2007. Conversation Clock: Visualizing audio patterns in co-located groups. In System Sciences, 2007. HICSS 2007. 40th Annual Hawaii International Conference on. IEEE, 78--78.

Digital Library

[4]

Sylvia Beyer. 2014. Why are women underrepresented in Computer Science? Gender differences in stereotypes, self-efficacy, values, and interests and predictors of future CS course-taking and grades. Computer Science Education, Vol. 24, 2--3 (2014), 153--192.

[5]

Madhumita Bhattacharya and Maggie Hartnett. 2007. E-portfolio assessment in higher education. In Frontiers In Education Conference-Global Engineering: Knowledge Without Borders, Opportunities Without Passports, 2007. FIE'07. 37th Annual. IEEE, T1G--19.

[6]

Virginia Braun and Victoria Clarke. 2013. Successful qualitative research: A practical guide for beginners .sage.

[7]

Amy Bruckman, Maureen Biggers, Barbara Ericson, Tom McKlin, Jill Dimond, Betsy DiSalvo, Mike Hewner, Lijun Ni, and Sarita Yardi. 2009. Georgia computes!: Improving the computing education pipeline. In ACM SIGCSE Bulletin, Vol. 41. ACM, 86--90.

Digital Library

[8]

Senthil Chandrasegaran, Sriram Karthik Badam, Lorraine Kisselburgh, Kylie Peppler, Niklas Elmqvist, and Karthik Ramani. 2017. VizScribe: A visual analytics approach to understand designer behavior. International Journal of Human-Computer Studies, Vol. 100 (2017), 66--80.

[9]

J McGrath Cohoon and William Aspray. 2006. Women and information technology: Research on underrepresentation. Vol. 1. The MIT Press.

Digital Library

[10]

Teresa Dahlberg, Tiffany Barnes, Kim Buch, and Audrey Rorrer. 2011. The STARS Alliance: Viable Strategies for Broadening Participation in Computing. Trans. Comput. Educ., Vol. 11, 3, Article 18 (Oct. 2011), bibinfonumpages25 pages.

Digital Library

[11]

Regina Deil-Amen. 2011. Socio-academic integrative moments: Rethinking academic and social integration among two-year college students in career-related programs. The Journal of Higher Education, Vol. 82, 1 (2011), 54--91.

[12]

Paul Drew and John Heritage. 2006. Conversation analysis. Vol. 1. Sage London.

[13]

Alan Fekete, Judy Kay, Jeff Kingston, and Kapila Wimalaratne. 2000. Supporting Reflection in Introductory Computer Science. In Proceedings of the Thirty-first SIGCSE Technical Symposium on Computer Science Education (SIGCSE '00). ACM, New York, NY, USA, 144--148.

Digital Library

[14]

Angela Fessl, Oliver Blunk, Michael Prilla, and Viktoria Pammer. 2017. The known universe of reflection guidance: a literature review. International Journal of Technology Enhanced Learning, Vol. 9, 2--3 (2017), 103--125.

Digital Library

[15]

Susan E. George. 2002. Learning and the Reflective Journal in Computer Science. Vol. 24. IEEE Computer Society Press, Los Alamitos, CA, USA. 77--86 pages.

Digital Library

[16]

Sten Govaerts, Katrien Verbert, Erik Duval, and Abelardo Pardo. 2012. The Student Activity Meter for Awareness and Self-reflection. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 869--884.

Digital Library

[17]

Robert A Hinde. 1972. Non-verbal communication .Cambridge University Press.

[18]

Dongsik Kim and Seunghee Lee. 2002. Designing collaborative reflection supporting tools in e-project-based learning environments. Journal of Interactive Learning Research, Vol. 13, 4 (2002), 375--392.

[19]

Tomi Kinnunen, Evgenia Chernenko, Marko Tuononen, Pasi Franti, and Haizhou Li. 2007. Voice activity detection using MFCC features and support vector machine. In Int. Conf. on Speech and Computer (SPECOM07), Moscow, Russia, Vol. 2. 556--561.

[20]

Celine Latulipe, Stephen MacNeil, and Brian Thompson. 2018. Evolving a Data Structures Class Toward Inclusive Success. In Frontiers in Education Conference (FIE 2018). IEEE, 1--5.

[21]

Colleen M Lewis, Ruth E Anderson, and Ken Yasuhara. 2016. I Don't Code All Day: Fitting in Computer Science When the Stereotypes Don't Fit. In Proceedings of the 2016 ACM Conference on International Computing Education Research. ACM, 23--32.

Digital Library

[22]

Colleen M. Lewis and Niral Shah. 2015. How Equity and Inequity Can Emerge in Pair Programming. In Proceedings of the Eleventh Annual International Conference on International Computing Education Research (ICER '15). ACM, New York, NY, USA, 41--50.

Digital Library

[23]

Stephen MacNeil. 2017. Tools to Support Data-driven Reflective Learning. Proceedings of the 2017 ACM Conference on International Computing Education Research (ICER '17). ACM, New York, NY, USA, 299--300.

Digital Library

[24]

Roberto Martinez, Judy Kay, James R Wallace, and Kalina Yacef. 2011. Modelling symmetry of activity as an indicator of collocated group collaboration. In International Conference on User Modeling, Adaptation, and Personalization. Springer, 207--218.

Digital Library

[25]

Joseph Edward McGrath. 1984. Groups: Interaction and performance. Vol. 14. Prentice-Hall Englewood Cliffs, NJ.

[26]

Jack Mezirow. 1998. On critical reflection. Adult education quarterly, Vol. 48, 3 (1998), 185--198.

[27]

Mavuto M Mukaka. 2012. A guide to appropriate use of correlation coefficient in medical research. Malawi Medical Journal, Vol. 24, 3 (2012), 69--71.

[28]

Rosemery O Nelson and Steven C Hayes. 1981. Theoretical explanations for reactivity in self-monitoring. Behavior Modification, Vol. 5, 1 (1981), 3--14.

[29]

Tia Newhall, Lisa Meeden, Andrew Danner, Ameet Soni, Frances Ruiz, and Richard Wicentowski. 2014. A support program for introductory CS courses that improves student performance and retains students from underrepresented groups. In Proceedings of the 45th ACM technical symposium on Computer science education. ACM, 433--438.

Digital Library

[30]

Johanna Okerlund, Madison Dunaway, Celine Latulipe, David Wilson, and Eric Paulos. 2018. Statement Making: A Maker Fashion Show Foregrounding Feminism, Gender, and Transdisciplinarity. In Proceedings of the 2018 Designing Interactive Systems Conference. ACM, 187--199.

Digital Library

[31]

Johanna Pirker, Maria Riffnaller-Schiefer, and Christian Gütl. 2014. Motivational Active Learning: Engaging University Students in Computer Science Education. In Proceedings of the 2014 Conference on Innovation & Technology in Computer Science Education (ITiCSE '14). ACM, New York, NY, USA, 297--302.

Digital Library

[32]

Gianluca Schiavo, Alessandro Cappelletti, Eleonora Mencarini, Oliviero Stock, and Massimo Zancanaro. 2014. Overt or subtle? Supporting group conversations with automatically targeted directives. In Proceedings of the 19th international conference on Intelligent User Interfaces. ACM, 225--234.

Digital Library

[33]

John R Searle and John Rogers Searle. 1969. Speech acts: An essay in the philosophy of language. Vol. 626. Cambridge university press.

[34]

Robert M Sellers, Tabbye M Chavous, and Deanna Y Cooke. 1998. Racial ideology and racial centrality as predictors of African American college students' academic performance. Journal of Black Psychology, Vol. 24, 1 (1998), 8--27.

[35]

Ben Shneiderman. 1996. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. In Proceedings of the 1996 IEEE Symposium on Visual Languages (VL '96). IEEE Computer Society, Washington, DC, USA, 336--. http://dl.acm.org/citation.cfm?id=832277.834354

Digital Library

[36]

Adam Stankiewicz and Chinmay Kulkarni. 2016. $1 Conversational Turn Detector: Measuring How Video Conversations Affect Student Learning in Online Classes. In Proceedings of the Third (2016) ACM Conference on Learning @ Scale (L@S '16). ACM, New York, NY, USA, 81--88.

Digital Library

[37]

Rong Tong, Bin Ma, Kong-Aik Lee, Changhuai You, Donglai Zhu, Tomi Kinnunen, Hanwu Sun, Minghui Dong, Eng Siong Chng, and Haizhou Li. 2006. The IIR NIST 2006 Speaker Recognition System: Fusion of Acoustic and Tokenization Features. In presentation in 5th Int. Symp. on Chinese Spoken Language Processing, ISCSLP .

[38]

Masahiro Toyoura, Mayato Sakaguchi, Xiaoyang Mao, Masanori Hanawa, and Masayuki Murakami. 2016. Visualizing the lesson process in active learning classes. In Frontiers in Education Conference (FIE), 2016 IEEE. IEEE, 1--8.

[39]

James Walker, Rita Borgo, and Mark W Jones. 2016. TimeNotes: a study on effective chart visualization and interaction techniques for time-series data. IEEE transactions on visualization and computer graphics, Vol. 22, 1 (2016), 549--558.

[40]

David C Webb, Alexander Repenning, and Kyu Han Koh. 2012. Toward an emergent theory of broadening participation in computer science education. In Proceedings of the 43rd ACM technical symposium on Computer Science Education. ACM, 173--178.

Digital Library

[41]

Victor H Yngve. 1970. On getting a word in edgewise. In Chicago Linguistics Society, 6th Meeting, 1970. 567--578.

[42]

Madeline Zug, Hanna Hoffman, Forest Kobayashi, Miles President, and Zachary Dodds. 2018. CS for All Academic Identities. J. Comput. Sci. Coll., Vol. 33, 4 (April 2018), 130--137. http://dl.acm.org/citation.cfm?id=3199572.3199590

Digital Library

Cited By

Joshi V(2024)Enhancing Collaboration and Performance among EMS Students through Multimodal Learning AnalyticsProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3688613(607-611)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3688613
Chandler CBreideband TReitman JChitwood MBush JHoward ALeonhart SFoltz PPenuel WD'Mello S(2024)Computational Modeling of Collaborative Discourse to Enable Feedback and Reflection in Middle School ClassroomsProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636917(576-586)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636917
Chen ZWang JXia MShigyo KLiu DZhang RQu H(2024)StuGPTViz: A Visual Analytics Approach to Understand Student-ChatGPT InteractionsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345636331:1(908-918)Online publication date: 23-Sep-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456363
Show More Cited By

Index Terms

IneqDetect: A Visual Analytics System to Detect Conversational Inequality and Support Reflection during Active Learning

Recommendations

Tools to Support Data-driven Reflective Learning
ICER '17: Proceedings of the 2017 ACM Conference on International Computing Education Research

Reflection is a process of "critical review" of previous experiences to inform future action. Reflection has its origins in design and engineering but has gained traction in education as well. Reflective learning affords students the opportunity to ...
Computer Support for Reflective Learning in the Workplace: A Model
ICALT '12: Proceedings of the 2012 IEEE 12th International Conference on Advanced Learning Technologies

In this paper we propose a model of Computer Supported Reflective Learning (CSRL) that links the reflection process to supportive ICT. The CSRL model has the potential to support analysis and design of CSRL solutions. It fills a gap that currently ...
A Reflective Learning Model to Computer Undergraduates
ICYCS '08: Proceedings of the 2008 The 9th International Conference for Young Computer Scientists

This paper presents a reflective learning model for computer undergraduates' education. After comparing the curriculums for the computer specialties in the prominent U.S. and Chinese universities, this paper suggests that Chinese computer undergraduates ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CompEd '19: Proceedings of the ACM Conference on Global Computing Education

May 2019

260 pages

ISBN:9781450362597

DOI:10.1145/3300115

General Chairs:
Ming Zhang
Peking University, China
,
Bo Yang
Linyi University, China
,
Program Chairs:
Steve Cooper
University of Nebraska-Lincoln, USA
,
Andrew Luxton-Reilly
University of Auckland, New Zealand

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCSE: ACM Special Interest Group on Computer Science Education

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 May 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CompEd '19

Sponsor:

SIGCSE

CompEd '19: ACM Global Computing Education Conference 2019

May 9 - 19, 2019

Chengdu,Sichuan, China

Acceptance Rates

CompEd '19 Paper Acceptance Rate 33 of 100 submissions, 33%;

Overall Acceptance Rate 33 of 100 submissions, 33%

Upcoming Conference

CompEd '25

Sponsor:
sigcse

ACM Global Computing Education Conference 2025

October 21 - 25, 2025

Gaborone , Botswana

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
248
Total Downloads

Downloads (Last 12 months)29
Downloads (Last 6 weeks)2

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Joshi V(2024)Enhancing Collaboration and Performance among EMS Students through Multimodal Learning AnalyticsProceedings of the 26th International Conference on Multimodal Interaction10.1145/3678957.3688613(607-611)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3678957.3688613
Chandler CBreideband TReitman JChitwood MBush JHoward ALeonhart SFoltz PPenuel WD'Mello S(2024)Computational Modeling of Collaborative Discourse to Enable Feedback and Reflection in Middle School ClassroomsProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636917(576-586)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636917
Chen ZWang JXia MShigyo KLiu DZhang RQu H(2024)StuGPTViz: A Visual Analytics Approach to Understand Student-ChatGPT InteractionsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345636331:1(908-918)Online publication date: 23-Sep-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456363
Ferreira ALima DOliveira WBittencourt IDermeval DReimers FIsotani S(2024)Exploring Brazilian Teachers’ Perceptions and a priori Needs to Design Smart ClassroomsInternational Journal of Artificial Intelligence in Education10.1007/s40593-024-00410-4Online publication date: 12-Jul-2024
https://doi.org/10.1007/s40593-024-00410-4
Breideband TBush JChandler CChang MDickler RFoltz PGanesh ALieber RPenuel WReitman JWeatherley JD'Mello S(2023)The Community Builder (CoBi): Helping Students to Develop Better Small Group Collaborative Learning SkillsCompanion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing10.1145/3584931.3607498(376-380)Online publication date: 14-Oct-2023
https://dl.acm.org/doi/10.1145/3584931.3607498
Ding ZKang JHO TWong KFung HMeng HMa X(2022)TalkTive: A Conversational Agent Using Backchannels to Engage Older Adults in Neurocognitive Disorders ScreeningProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502005(1-19)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502005
MacNeil SDing ZBoone AGrubbs ADow S(2021)Finding Place in a Design SpaceProceedings of the ACM on Human-Computer Interaction10.1145/34492465:CSCW1(1-30)Online publication date: 22-Apr-2021
https://dl.acm.org/doi/10.1145/3449246
Cornide-Reyes HRiquelme FMonsalves DNoel RCechinel CVillarroel RPonce FMunoz R(2020)A Multimodal Real-Time Feedback Platform Based on Spoken Interactions for Remote Active Learning SupportSensors10.3390/s2021633720:21(6337)Online publication date: 6-Nov-2020
https://doi.org/10.3390/s20216337
Martinez-Maldonado REcheverria VFernandez Nieto GBuckingham Shum SBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)From Data to Insights: A Layered Storytelling Approach for Multimodal Learning AnalyticsProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376148(1-15)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376148

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents