research-article

Open access

Collecting, Analyzing, and Acting on Intersectional, Longitudinal Data and Pass/Fail/Withdraw Rates in Computing Courses

Authors:

Megan Giordano,

Carla E. BrodleyAuthors Info & Claims

SIGCSE 2024: Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1

Pages 909 - 915

https://doi.org/10.1145/3626252.3630806

Published: 07 March 2024 Publication History

Abstract

We present the Center for Inclusive Computing's data collection and visualization system, which enables computing departments to track and visualize their enrollment and course outcome data intersectionally and longitudinally. The system tracks the impact of institutional changes in how computing (particularly the introductory sequence) is discovered and experienced by undergraduates as measured by course outcome and persistence data. To date we have worked with and collected data from 52 U.S. computing departments. Collected data spans 2018-present and contains term-by- term, intersectional course enrollment and outcome data for CS 1-3, while also tracking declared majors and persistence to graduation. Drawing on our experience working with these universities we present guidelines for the analysis of intersectional, longitudinal data alongside our recommendations for actionable next steps. We present three case studies grounded in an analysis of CS1, demon- strating how an institution can understand their own computing program and develop interventions-specifically with an eye toward broadening participation in computing.

References

[1]

Valerie Barr, Carla E. Brodley, and Manuel Pérez-Qui nones. 2024. Visualizing progress in broadening participation in computing: The value of context. Commun. ACM (to appear 2024).

[2]

Carla E. Brodley. 2022a. Expanding the pipeline: Addressing the distribution of prior experience in CS1. Computing Research News, Vol. 34, 6 (June 2022). http://doi.acm.org/10.1145/1219092.1219093

[3]

Carla E. Brodley. 2022b. Why universities must resist GPA-based enrollment caps in the case of surging enrollments. Commun. ACM, Vol. 65, 8 (Aug. 2022), 20--22. https://doi.org/10.1145/3544547

Digital Library

[4]

Carla E. Brodley and Catherine Gill. 2024. The BPC relevance of common assessment in the introductory sequence. Commun. ACM (to appear 2024).

[5]

Carla E Brodley, Catherine Gill, and Sally Wynn. 2021. Diagnosing why representation remains elusive at your university: Lessons learned from the Center for Inclusive Computing's site visits. In 2021 Conference on Research in Equitable and Sustained Participation in Engineering, Computing, and Technology (RESPECT). IEEE, 1--4.

[6]

National Student Clearinghouse. 2023. https://help.studentclearinghouse.org/pdp/.

[7]

James P Cohoon and Luther A Tychonievich. 2011. Analysis of a CS1 approach for attracting diverse and inexperienced students to computing majors. In Proceedings of the 42nd ACM technical symposium on Computer science education. 165--170.

Digital Library

[8]

Nicholas B Colvard, C Edward Watson, and Hyojin Park. 2018. The impact of open educational resources on various student success metrics. International Journal of Teaching and Learning in Higher Education, Vol. 30, 2 (2018), 262--276.

[9]

Christina Convertino. 2020. Nuancing the discourse of underrepresentation: a feminist post-structural analysis of gender inequality in computer science education in the US. Gender and education, Vol. 32, 5 (2020), 594--607.

[10]

Adrienne Decker, Christopher Egert, and Erin Cascioli. 2020. Cohorting incoming students in a CS1 course: Experiences and reflections from the first year of implementation. Journal of Computing Sciences in Colleges, Vol. 35, 8 (2020), 186--197.

Digital Library

[11]

Adrienne Decker, Monica M McGill, and Amber Settle. 2016. Towards a common framework for evaluating computing outreach activities. In Proceedings of the 47th ACM Technical Symposium on Computing Science Education. 627--632.

Digital Library

[12]

National Center for Education Statistics U.S. Department of Education. 2023. The Integrated Postsecondary Education Data System. https://nces.ed.gov/ipeds/. (Retrieved July 2023).

[13]

Ahir Gopaldas and Glenna DeRoy. 2015. An intersectional approach to diversity research. Consumption Markets & Culture, Vol. 18, 4 (2015), 333--364. https://doi.org/10.1080/10253866.2015.1019872 https://doi.org/10.1145/3341525.3387360

[14]

Yolanda A Rankin and Jakita O Thomas. 2020. The intersectional experiences of Black women in computing. In Proceedings of the 51st ACM technical symposium on computer science education. 199--205.

Digital Library

[15]

Monique Ross, Zahra Hazari, Gerhard Sonnert, and Philip Sadler. 2020. The Intersection of Being Black and Being a Woman: Examining the Effect of Social Computing Relationships on Computer Science Career Choice. ACM Trans. Comput. Educ., Vol. 20, 2, Article 9 (feb 2020), bibinfonumpages15 pages. https://doi.org/10.1145/3377426

Digital Library

[16]

Chris Stephenson, Alison Derbenwick Miller, Christine Alvarado, Lecia Barker, Valerie Barr, Tracy Camp, Carol Frieze, Colleen Lewis, Erin Cannon Mindell, Lee Limbird, et al. 2018. Retention in computer science undergraduate programs in the us: Data challenges and promising interventions. ACM.

[17]

Carolee Stewart-Gardiner, David G Kay, Joyce Currie Little, Joseph D Chase, John Fendrich, Laurie A Williams, and Ursula Wolz. 2001. Collaboration vs plagiarism in computer science programming courses. ACM SIGCSE Bulletin, Vol. 33, 1 (2001), 406--407.

Digital Library

[18]

Mark G Urtel. 2008. Assessing academic performance between traditional and distance education course formats. (2008).

[19]

Benjamin Xie, Alannah Oleson, Jayne Everson, and Amy J. Ko. 2022. Surfacing Equity Issues in Large Computing Courses with Peer-Ranked, Demographically-Labeled Student Feedback. Proc. ACM Hum.-Comput. Interact., Vol. 6, CSCW1, Article 65 (apr 2022), bibinfonumpages39 pages. https://doi.org/10.1145/3512912

Digital Library

[20]

Stuart Zweben and Betsy Bizot. 2022. 2021 Taulbee Survey. (2022).

Cited By

Brodley CQuam MWeiss M(2024)An Analysis of the Math Requirements of 199 CS BS/BA Degrees at 158 U.S. UniversitiesCommunications of the ACM10.1145/3661482Online publication date: 31-Jul-2024
https://doi.org/10.1145/3661482
Brodley CGill C(2024)The BPC Relevance of Common Assessment in the Introductory SequenceCommunications of the ACM10.1145/363789167:7(24-26)Online publication date: 28-Jun-2024
https://dl.acm.org/doi/10.1145/3637891
Barr VBrodley CPérez-Quiñones M(2024)Visualizing Progress in Broadening Participation in Computing: The Value of ContextCommunications of the ACM10.1145/363547167:7(46-55)Online publication date: 2-Jul-2024
https://dl.acm.org/doi/10.1145/3635471

Index Terms

Collecting, Analyzing, and Acting on Intersectional, Longitudinal Data and Pass/Fail/Withdraw Rates in Computing Courses
1. Social and professional topics
  1. Professional topics
    1. Computing education

Recommendations

Computing Self-Efficacy in Undergraduate Students: A Multi-Institutional and Intersectional Analysis
SIGCSE 2024: Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1

Computing self-efficacy is an important factor in shaping students' motivation, performance, and persistence in computer science (CS) courses. Therefore, investigating computing self-efficacy may help to improve the persistence of students from ...
The Intersectional Experiences of Black Women in Computing
SIGCSE '20: Proceedings of the 51st ACM Technical Symposium on Computer Science Education

Efforts to broaden participation in computing have led to gender-focused interventions intended to increase the number of women in the field of computing. However, such efforts have failed to significantly increase the percentage of Black women in ...
Quantifying Disparities in Computing Education: Access, Participation, and Intersectionality
SIGCSE '21: Proceedings of the 52nd ACM Technical Symposium on Computer Science Education

Quantitative research in CS education has suffered from inattention to complexities inherent in measuring educational equity. This study aims to tease apart the complexities of educational equity and advance the field by developing a disparity index for ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCSE 2024: Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 1

March 2024

1583 pages

ISBN:9798400704239

DOI:10.1145/3626252

General Chairs:
Ben Stephenson
University of Calgary, Canada6000230660002306
,
Jeffrey A. Stone
Penn State University6000143960001439
,
Program Chairs:
Lina Battestilli
North Carolina State University, USA6000492360004923
,
Samuel A. Rebelsky
Grinnell College60028806
,
Libby Shoop
Macalester College60028787

Copyright © 2024 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCSE: ACM Special Interest Group on Computer Science Education

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2024

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

NSF (National Science Foundation)

Conference

SIGCSE 2024

Sponsor:

SIGCSE

SIGCSE 2024: The 55th ACM Technical Symposium on Computer Science Education

March 20 - 23, 2024

OR, Portland, USA

Acceptance Rates

Overall Acceptance Rate 1,595 of 4,542 submissions, 35%

Upcoming Conference

SIGCSE TS 2025

Sponsor:
sigcse

The 56th ACM Technical Symposium on Computer Science Education

February 26 - March 1, 2025

Pittsburgh , PA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
219
Total Downloads

Downloads (Last 12 months)219
Downloads (Last 6 weeks)34

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Brodley CQuam MWeiss M(2024)An Analysis of the Math Requirements of 199 CS BS/BA Degrees at 158 U.S. UniversitiesCommunications of the ACM10.1145/3661482Online publication date: 31-Jul-2024
https://doi.org/10.1145/3661482
Brodley CGill C(2024)The BPC Relevance of Common Assessment in the Introductory SequenceCommunications of the ACM10.1145/363789167:7(24-26)Online publication date: 28-Jun-2024
https://dl.acm.org/doi/10.1145/3637891
Barr VBrodley CPérez-Quiñones M(2024)Visualizing Progress in Broadening Participation in Computing: The Value of ContextCommunications of the ACM10.1145/363547167:7(46-55)Online publication date: 2-Jul-2024
https://dl.acm.org/doi/10.1145/3635471

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents