research-article

Modeling Improvement for Underrepresented Minorities in Online STEM Education

Authors:

Lawrence Angrave,

Michelle PerryAuthors Info & Claims

UMAP '19: Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization

Pages 327 - 335

https://doi.org/10.1145/3320435.3320463

Published: 07 June 2019 Publication History

Abstract

Previous research has shown that students from underrepresented minority groups tend to receive lower grades in online classes than their peers, especially in science-focused courses. We propose that there may also be benefits to online courses for these students (e.g., opportunities for peer discussions where minority status is less salient), though little is currently known about these potential benefits. We present a new perspective on learning outcomes by measuring improvement, rather than grades alone. In learning management system data from seven semesters of an online introductory science course, we found that students from underrepresented minority racial groups were indeed less likely to receive high grades, and scored lower on exams; however, their exam scores improved throughout the semester a similar amount compared to their peers. We also compared improvement to students' behaviors, including exam submission times and forum usage, finding that these behaviors were related to improvement. Finally, we also briefly discuss implications of these findings for reducing inequalities in education, and the possibilities for underrepresented minority students in online STEM education in particular.

References

[1]

Jeff Allen and Jim Sconing. 2005. Using ACT assessment scores to set benchmarks for college readiness . Technical Report 3. ACT Inc, Iowa City, IA. https://eric.ed.gov/?id=ED489766

[2]

Ryan S. Baker, David Lindrum, Mary Jane Lindrum, and David Perkowski. 2015. Analyzing early at-risk factors in higher education e-learning courses. In Proceedings of the 8th International Conference on Educational Data Mining (EDM 2015) . International Educational Data Mining Society, 150--155.

[3]

David N. Beede, Tiffany A. Julian, David Langdon, George McKittrick, Beethika Khan, and Mark E. Doms. 2011. Women in STEM: A gender gap to innovation . SSRN Scholarly Paper ID 1964782. Social Science Research Network, Rochester, NY.

[4]

Lin Bian, Sarah-Jane Leslie, and Andrei Cimpian. 2017. Gender stereotypes about intellectual ability emerge early and influence children's interests. Science, Vol. 355, 6323 (Jan. 2017), 389--391.

[5]

Lin Bian, Sarah-Jane Leslie, Mary C. Murphy, and Andrei Cimpian. 2018. Messages about brilliance undermine women's interest in educational and professional opportunities. Journal of Experimental Social Psychology, Vol. 76 (May 2018), 404--420.

[6]

Nigel Bosch, R. Wes Crues, Genevieve M. Henricks, Michelle Perry, Lawrence Angrave, Najmuddin Shaik, Suma Bhat, and Carolyn J. Anderson. 2018. Modeling key differences in underrepresented students' interactions with an online STEM course. In Proceedings of TechMindSociety '18 . ACM, New York, NY, 6:1--6:6.

[7]

Eleanor K. Chestnut, Ryan F. Lei, Sarah-Jane Leslie, and Andrei Cimpian. 2018. The myth that only brilliant people are good at math and its implications for diversity. Education Sciences, Vol. 8, 2 (June 2018), 65.

[8]

Daryl E. Chubin, Gary S. May, and Eleanor L. Babco. 2005. Diversifying the engineering workforce. Journal of Engineering Education, Vol. 94, 1 (Jan. 2005), 73--86.

[9]

Susana Claro, David Paunesku, and Carol S. Dweck. 2016. Growth mindset tempers the effects of poverty on academic achievement. Proceedings of the National Academy of Sciences, Vol. 113, 31 (Aug. 2016), 8664--8668.

[10]

Scott Crossley, Mihai Dascalu, Danielle S. McNamara, Ryan S. Baker, and Stefan Trausan-Matu. 2017. Predicting success in massive open online courses (MOOCs) using cohesion network analysis. In 12th International Conference on Computer Supported Collaborative Learning (CSCL 2017), B. K. Smith, M. Borge, E. Mercier, and K. Y. Lim (Eds.). International Society of the Learning Sciences, Philadelphia, PA, 103--110.

[11]

Scott Crossley, Luc Paquette, Mihai Dascalu, Danielle S. McNamara, and Ryan S. Baker. 2016. Combining click-stream data with NLP tools to better understand MOOC completion. In Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (LAK '16). ACM, New York, NY, USA, 6--14.

Digital Library

[12]

R. Wes Crues, Nigel Bosch, Michelle Perry, Lawrence Angrave, Najmuddin Shaik, and Suma Bhat. 2018a. Refocusing the lens on engagement in MOOCs. In Proceedings of the 5th ACM Conference on Learning@Scale (L@S 2018), Rose Luckin, Scott Klemmer, and Kenneth R. Koedinger (Eds.). ACM, New York, NY, 11:1--11:10.

Digital Library

[13]

R. Wes Crues, Genevieve M. Henricks, Michelle Perry, Suma Bhat, Carolyn J. Anderson, Najmuddin Shaik, and Lawrence Angrave. 2018b. How do gender, learning goals, and forum participation predict persistence in a computer science MOOC? ACM Transactions on Computing Education, Vol. 18, 4 (2018), 18:1--18:14.

Digital Library

[14]

Olive Jean Dunn. 1961. Multiple comparisons among means. J. Amer. Statist. Assoc., Vol. 56, 293 (March 1961), 52--64.

[15]

Susan T. Fiske. 1998. Stereotyping, prejudice, and discrimination. In Handbook of social psychology 4 ed.), Daniel T. Gilbert, Susan T. Fiske, and Gardner Lindzey (Eds.). Vol. 2. McGraw-Hill, Boston, 357--411.

[16]

Tierra M. Freeman, Lynley H. Anderman, and Jane M. Jensen. 2007. Sense of belonging in college freshmen at the classroom and campus levels. The Journal of Experimental Education, Vol. 75, 3 (April 2007), 203--220.

[17]

Jennifer L. Glass, Sharon Sassler, Yael Levitte, and Katherine M. Michelmore. 2013. What's so special about STEM? A comparison of women's retention in STEM and professional occupations. Social Forces, Vol. 92, 2 (Dec. 2013), 723--756.

[18]

Carol Goodenow. 1993. The psychological sense of school membership among adolescents: Scale development and educational correlates. Psychology in the Schools, Vol. 30, 1 (1993), 79--90.

[19]

Amanda L. Griffith. 2010. Persistence of women and minorities in STEM field majors: Is it the school that matters? Economics of Education Review, Vol. 29, 6 (Dec. 2010), 911--922.

[20]

Philip J. Guo and Katharina Reinecke. 2014. Demographic differences in how students navigate through MOOCs. In Proceedings of the First ACM Conference on Learning @ Scale Conference (L@S '14). ACM, New York, NY, 21--30.

Digital Library

[21]

Sylvia Hurtado and Deborah Faye Carter. 1997. Effects of college transition and perceptions of the campus racial climate on Latino college students' sense of belonging. Sociology of Education, Vol. 70, 4 (1997), 324--345.

[22]

Suhang Jiang, Mark Warschauer, Adrienne E. Williams, Diane O'Dowd, and Katerina Schenke. 2014. Predicting MOOC performance with week 1 behavior. In Proceedings of the 7th International Conference on Educational Data Mining. Educational Data Mining Society, 273--275.

[23]

Dawn R. Johnson, Matthew Soldner, Jeannie Brown Leonard, Patty Alvarez, Karen Kurotsuchi Inkelas, Heather T. Rowan-Kenyon, and Susan D. Longerbeam. 2007. Examining sense of belonging among first-year undergraduates from different racial/ethnic groups. Journal of College Student Development, Vol. 48, 5 (Sept. 2007), 525--542.

[24]

Ray Kaupp. 2012. Online penalty: The impact of online instruction on the Latino-white achievement gap. Journal of Applied Research in the Community College, Vol. 19, 2 (April 2012), 3--11.

[25]

Seongho Kim. 2015. ppcor: An R package for a fast calculation to semi-partial correlation coefficients. Communications for Statistical Applications and Methods, Vol. 22, 6 (Nov. 2015), 665--674.

[26]

René F. Kizilcec and Sherif Halawa. 2015. Attrition and achievement gaps in online learning. In Proceedings of the Second (2015) ACM Conference on Learning @ Scale. ACM, New York, NY, 57--66.

Digital Library

[27]

René F. Kizilcec, Chris Piech, and Emily Schneider. 2013. Deconstructing disengagement: Analyzing learner subpopulations in massive open online courses. In Proceedings of the Third International Conference on Learning Analytics and Knowledge (LAK 2013) . ACM, New York, NY, 170--179.

Digital Library

[28]

Marius Kloft, Felix Stiehler, Zhilin Zheng, and Niels Pinkwart. 2014. Predicting MOOC dropout over weeks using machine learning methods. In Proceedings of the EMNLP 2014 Workshop on Analysis of Large Scale Social Interaction in MOOCs. Association for Computational Linguistics, Stroudsburg, PA, 60--65.

[29]

David Langdon, George McKittrick, David Beede, Beethika Khan, and Mark Doms. 2011. STEM: Good jobs now and for the future .US Department of Commerce, Washington, DC, USA.

[30]

Sarah-Jane Leslie, Andrei Cimpian, Meredith Meyer, and Edward Freeland. 2015. Expectations of brilliance underlie gender distributions across academic disciplines. Science, Vol. 347, 6219 (Jan. 2015), 262--265.

[31]

Mikael Luciak. 2004. Minority status and schooling-John U. Ogbu's theory and the schooling of ethnic minorities in Europe . Intercultural Education, Vol. 15, 4 (Dec. 2004), 359--368.

[32]

Leah P. Macfadyen and Shane Dawson. 2010. Mining LMS data to develop an "early warning system" for educators: A proof of concept. Computers & Education, Vol. 54, 2 (Feb. 2010), 588--599.

Digital Library

[33]

Jason McDonald. 2014. The role of invitational theory on minority student enrollment in advanced placement courses . PhD Thesis. University of Central Florida. https://stars.library.ucf.edu/etd/4767

[34]

B. Minaei-Bidgoli, D. A. Kashy, G. Kortemeyer, and W. F. Punch. 2003. Predicting student performance: An application of data mining methods with an educational Web-based system. In 33rd Annual Frontiers in Education Conference (FIE 2003). IEEE, Piscataway, NJ, 13--18.

[35]

John U. Ogbu and Herbert D. Simons. 1998. Voluntary and involuntary minorities: A cultural-ecological theory of school performance with some implications for education. Anthropology & Education Quarterly, Vol. 29, 2 (1998), 155--188.

[36]

Patrick O'Keeffe. 2013. A sense of belonging: Improving student retention. College Student Journal, Vol. 47, 4 (Dec. 2013), 605--613.

[37]

Terrell L. Strayhorn. 2012. College students' sense of belonging: A key to educational success for all students 1st ed.). Routledge, New York, NY.

[38]

R Core Team. 2013. R: A language and environment for statistical computing. (2013).

[39]

Claire Wladis, Katherine M. Conway, and Alyse C. Hachey. 2015a. The online STEM classroom-Who succeeds? An exploration of the impact of ethnicity, gender, and non-traditional student characteristics in the community college context. Community College Review, Vol. 43, 2 (April 2015), 142--164.

[40]

Claire Wladis, Alyse C. Hachey, and Katherine Conway. 2015b. Which STEM majors enroll in online courses, and why should we care? The impact of ethnicity, gender, and non-traditional student characteristics. Computers & Education, Vol. 87 (Sept. 2015), 285--308.

Digital Library

[41]

Di Xu and Shanna Smith Jaggars. 2011. The effectiveness of distance education across Virginia's community colleges: Evidence from introductory college-level math and English courses. Educational Evaluation and Policy Analysis, Vol. 33, 3 (Sept. 2011), 360--377.

[42]

Di Xu and Shanna S. Jaggars. 2014. Performance gaps between online and face-to-face courses: Differences across types of students and academic subject areas. The Journal of Higher Education, Vol. 85, 5 (Sept. 2014), 633--659.

[43]

Cheng Ye and Gautam Biswas. 2014. Early prediction of student dropout and performance in MOOCs using higher granularity temporal information. Journal of Learning Analytics, Vol. 1, 3 (2014), 169--172.

[44]

David S. Yeager, Carissa Romero, Dave Paunesku, Christopher S. Hulleman, Barbara Schneider, Cintia Hinojosa, Hae Yeon Lee, Joseph O'Brien, Kate Flint, Alice Roberts, Jill Trott, Daniel Greene, Gregory M. Walton, and Carol S. Dweck. 2016. Using design thinking to improve psychological interventions: The case of the growth mindset during the transition to high school. Journal of Educational Psychology, Vol. 108, 3 (April 2016), 374--391.

Cited By

Baker RHutt SBosch NOcumpaugh JBiswas GPaquette LAndres JNasiar NMunshi A(2023)Detector-driven classroom interviewing: focusing qualitative researcher time by selecting cases in situEducational technology research and development10.1007/s11423-023-10324-yOnline publication date: 22-Dec-2023
https://doi.org/10.1007/s11423-023-10324-y
Williams-Dobosz DAzevedo RJeng AThakkar VBhat SBosch NPerry MScheffel MDowell NJoksimovic SSiemens G(2021)A Social Network Analysis of Online Engagement for College Students Traditionally Underrepresented in STEMLAK21: 11th International Learning Analytics and Knowledge Conference10.1145/3448139.3448159(207-215)Online publication date: 12-Apr-2021
https://dl.acm.org/doi/10.1145/3448139.3448159
Angrave LJensen KZhang ZMahipal CMussulman DSchmitz CBaird RLiu HSui RWu MKooper R(2020)Improving Student Accessibility, Equity, Course Performance, and Lab Skills: How Introduction of ClassTranscribe is Changing Engineering Education at the University of Illinois2020 ASEE Virtual Annual Conference Content Access Proceedings10.18260/1-2--34796Online publication date: Jun-2020
https://doi.org/10.18260/1-2--34796

Index Terms

Modeling Improvement for Underrepresented Minorities in Online STEM Education
1. Applied computing
  1. Education
    1. E-learning
    2. Learning management systems

Recommendations

CS@Mines Successful S-STEM Scholarship Ecosystem for Low-Income and Underrepresented Students
SIGCSE '21: Proceedings of the 52nd ACM Technical Symposium on Computer Science Education

The primary purpose of PATHS (Path Ambassadors to High Success), an NSF-funded S-STEM scholarship program, is to create new pathways and strengthen existing pathways for academically talented, low-income Colorado high school and community college ...
Stimulating information technology education among underrepresented minorities
CITC5 '04: Proceedings of the 5th conference on Information technology education

The focus of this paper is the information technology higher education pipeline, and why so few male and female African American and Latino/a students are studying computer science at the college level. We specifically have researched the experiences, ...
STEM teaching as an additional profession for scientists and engineers: the case of computer science education
SIGCSE '14: Proceedings of the 45th ACM technical symposium on Computer science education

The conference theme - "Leveraging Computing to Change Education" - focuses on the influence of computing on the way we educate at all levels. In this paper we highlight the conference theme from the perspective of computer science (CS) teacher ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UMAP '19: Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization

June 2019

377 pages

ISBN:9781450360210

DOI:10.1145/3320435

General Chairs:
George Angelos Papadopoulos
University of Cyprus, Cyprus
,
George Samaras
University of Cyprus, Cyprus
,
Stephan Weibelzahl
PFH Private University of Applied Sciences Göttingen, Germany
,
Program Chairs:
Dietmar Jannach
Alpen-Adria-Universität Klagenfurt, Austria
,
Olga C. Santos
aDeNu Research Group - UNED, Spain

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Institute of Education Sciences

Conference

UMAP '19

Sponsor:

UMAP '19: 27th Conference on User Modeling, Adaptation and Personalization

June 9 - 12, 2019

Larnaca, Cyprus

Acceptance Rates

UMAP '19 Paper Acceptance Rate 30 of 122 submissions, 25%;

Overall Acceptance Rate 162 of 633 submissions, 26%

Upcoming Conference

UMAP '25

Sponsor:
sigchi
sigchi

33rd ACM Conference on User Modeling, Adaptation and Personalization

June 16 - 19, 2025

New York City , NY , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
340
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)14

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Baker RHutt SBosch NOcumpaugh JBiswas GPaquette LAndres JNasiar NMunshi A(2023)Detector-driven classroom interviewing: focusing qualitative researcher time by selecting cases in situEducational technology research and development10.1007/s11423-023-10324-yOnline publication date: 22-Dec-2023
https://doi.org/10.1007/s11423-023-10324-y
Williams-Dobosz DAzevedo RJeng AThakkar VBhat SBosch NPerry MScheffel MDowell NJoksimovic SSiemens G(2021)A Social Network Analysis of Online Engagement for College Students Traditionally Underrepresented in STEMLAK21: 11th International Learning Analytics and Knowledge Conference10.1145/3448139.3448159(207-215)Online publication date: 12-Apr-2021
https://dl.acm.org/doi/10.1145/3448139.3448159
Angrave LJensen KZhang ZMahipal CMussulman DSchmitz CBaird RLiu HSui RWu MKooper R(2020)Improving Student Accessibility, Equity, Course Performance, and Lab Skills: How Introduction of ClassTranscribe is Changing Engineering Education at the University of Illinois2020 ASEE Virtual Annual Conference Content Access Proceedings10.18260/1-2--34796Online publication date: Jun-2020
https://doi.org/10.18260/1-2--34796

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents