extended-abstract

Steps Learners Take when Solving Programming Tasks, and How Learning Environments (Should) Respond to Them

Authors:

Dennis Bouvier,

Natalie Kiesler,

Teemu Lehtinen,

Andrew Petersen,

Sami SarsaAuthors Info & Claims

ITiCSE '22: Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 2

Pages 570 - 571

https://doi.org/10.1145/3502717.3532168

Published: 07 July 2022 Publication History

Abstract

Every year, millions of students learn how to write programs. Learning activities for beginners almost always include programming tasks that require a student to write a program to solve a particular problem. When learning how to solve such a task, many students need feedback on their previous actions, and hints on how to proceed. In the case of programming, the feedback should take the steps a student has taken towards implementing a solution into account, and the hints should help a student to complete or improve a possibly partial solution. Only a limited number of learning environments for programming give feedback and hints on intermediate steps students take towards a solution, and little is known about the quality of the feedback provided. To determine the quality of feedback of such tools and to help further developing them, we create and curate data sets that show what kinds of steps students take when solving programming exercises for beginners, and what kind of feedback and hints should be provided. This working group aims to 1) select or create several data sets with steps students take to solve programming tasks, 2) introduce a method to annotate students' steps in these data sets, 3) attach feedback and hints to these steps, 4) set up a method to utilize these data sets in various learning environments for programming, and 5) analyse the quality of hints and feedback in these learning environments.

References

[1]

Joseph E. Beck, Kai Min Chang, Jack Mostow, and Albert Corbett. 2008. Does help help? Introducing the Bayesian Evaluation and Assessment Methodology. In Proceedings of the International Conference on Intelligent Tutoring Systems .

Digital Library

[2]

Neil Christopher Charles Brown, Michael Kölling, Davin McCall, and Ian Utting. 2014. Blackbox: A Large Scale Repository of Novice Programmers' Activity. In Proceedings of the ACM Technical Symposium on Computer Science Education (SIGCSE).

Digital Library

[3]

code.org. 2014. Hoc4 and Hoc18 datasets. (2014). https://code.org/research.

[4]

Tyne Crow, Andrew Luxton-Reilly, and Burkhard Wuensche. 2018. Intelligent Tutoring Systems for Programming Education: A Systematic Review. In Proceedings of the Australasian Computing Education Conference .

Digital Library

[5]

Alex Gerdes, Bastiaan Heeren, Johan Jeuring, and L. Thomas van Binsbergen. 2017. Ask-Elle: an Adaptable Programming Tutor for Haskell Giving Automated Feedback. International Journal of Artificial Intelligence in Education, Vol. 27, 1 (2017).

[6]

Andreas Giannakoulas and Stelios Xinogalos. 2020. A review of educational games for teaching programming to primary school students. Handbook of Research on Tools for Teaching Computational Thinking in P-12 Education (2020).

[7]

Samiha Marwan, Ge Gao, Susan Fisk, Thomas W. Price, and Tiffany Barnes. 2020. Adaptive Immediate Feedback Can Improve Novice Programming Engagement and Intention to Persist in Computer Science. In Proceedings of the ACM Conference on International Computing Education Research (ICER) .

Digital Library

[8]

Samiha Marwan, Joseph Jay Williams, and Thomas Price. 2019. An Evaluation of the Impact of Automated Programming Hints on Performance and Learning. In Proceedings of the International Computing Education Research Conference .

Digital Library

[9]

Benjamin Paaßen. 2019. Python Programming Dataset. (2019). https://doi.org/10.4119/unibi/2941052 Bielefeld University.

[10]

Thomas W. Price, Yihuan Dong, and Dragan Lipovac. 2017. iSnap: towards intelligent tutoring in novice programming environments. In Proceedings of the ACM SIGCSE Technical Symposium on computer science education .

Digital Library

[11]

Thomas W. Price, Yihuan Dong, Rui Zhi, Benjamin Paaßen, Nicholas Lytle, Veronica Cateté, and Tiffany Barnes. 2019. A comparison of the quality of data-driven programming hint generation algorithms. International Journal of Artificial Intelligence in Education, Vol. 29, 3 (2019).

[12]

Thomas W. Price, David Hovemeyer, Kelly Rivers, Ge Gao, Austin Cory Bart, Ayaan M. Kazerouni, Brett A. Becker, Andrew Petersen, Luke Gusukuma, Stephen H. Edwards, and David Babcock. 2020. ProgSnap2: A Flexible Format for Programming Process Data. In Proceedings of the ACM Conference on Innovation and Technology in Computer Science Education (ITiCSE).

Digital Library

[13]

Kelly Rivers and Kenneth R Koedinger. 2017. Data-driven hint generation in vast solution spaces: a self-improving Python programming tutor. International Journal of Artificial Intelligence in Education, Vol. 27, 1 (2017).

[14]

Valerie J. Shute. 2008. Focus on formative feedback . Review of Educational Research, Vol. 78, 1 (2008).

[15]

Kurt VanLehn. 2011. The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring Systems. Educ. Psych., Vol. 46, 4 (2011).

Cited By

Kiesler NImpagliazzo JBiernacka KKapoor AKazmi ZRamagoni SSane ATran KTaneja SWu ZChoppella VPhatak DLuxton-Reilly ACraig M(2024)Where's the Data? Finding and Reusing Datasets in Computing EducationWorking Group Reports on 2023 ACM Conference on Global Computing Education10.1145/3598579.3689378(31-60)Online publication date: 23-Sep-2024
https://dl.acm.org/doi/10.1145/3598579.3689378
Kiesler N(2023)Investigating the Use and Effects of Feedback in CodingBat Exercises: An Exploratory Thinking Aloud Study2023 Future of Educational Innovation-Workshop Series Data in Action10.1109/IEEECONF56852.2023.10104622(1-12)Online publication date: 16-Jan-2023
https://doi.org/10.1109/IEEECONF56852.2023.10104622
Kiesler NKiesler N(2023)Results of Guided Expert InterviewsModeling Programming Competency10.1007/978-3-031-47148-3_9(111-131)Online publication date: 10-Oct-2023
https://doi.org/10.1007/978-3-031-47148-3_9
Show More Cited By

Index Terms

Steps Learners Take when Solving Programming Tasks, and How Learning Environments (Should) Respond to Them
1. Social and professional topics
  1. Professional topics
    1. Computing education

Recommendations

Towards Giving Timely Formative Feedback and Hints to Novice Programmers
ITiCSE-WGR '22: Proceedings of the 2022 Working Group Reports on Innovation and Technology in Computer Science Education

Every year, millions of students learn how to write programs. Learning activities for beginners almost always include programming tasks that require a student to write a program to solve a particular problem. When learning how to solve such a task, many ...
Ne-course for learning programming
TEEM '16: Proceedings of the Fourth International Conference on Technological Ecosystems for Enhancing Multiculturality

Difficulties in learning programming are a constant concern in engineering courses. In many research studies involving the learning programming must of the solutions presented, from the beginning of the first programming languages, was to apply different ...
End user programming/informal programming

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ITiCSE '22: Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education Vol. 2

July 2022

686 pages

ISBN:9781450392006

DOI:10.1145/3502717

General Chairs:
Brett A. Becker
University College Dublin, Ireland
,
Keith Quille
Technological University Dublin, Ireland
,
Mikko-Jussi Laakso
University of Turku, Finland
,
Program Chairs:
Erik Barendsen
Radboud University & Open University, The Netherlands
,
Simon
Unaffiliated, Australia

Copyright © 2022 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCSE: ACM Special Interest Group on Computer Science Education

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2022

Check for updates

Author Tags

Qualifiers

Extended-abstract

Conference

ITiCSE 2022

Sponsor:

SIGCSE

ITiCSE 2022: Innovation and Technology in Computer Science Education

July 8 - 13, 2022

Dublin, Ireland

Acceptance Rates

Overall Acceptance Rate 552 of 1,613 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
178
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)6

Reflects downloads up to 27 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kiesler NImpagliazzo JBiernacka KKapoor AKazmi ZRamagoni SSane ATran KTaneja SWu ZChoppella VPhatak DLuxton-Reilly ACraig M(2024)Where's the Data? Finding and Reusing Datasets in Computing EducationWorking Group Reports on 2023 ACM Conference on Global Computing Education10.1145/3598579.3689378(31-60)Online publication date: 23-Sep-2024
https://dl.acm.org/doi/10.1145/3598579.3689378
Kiesler N(2023)Investigating the Use and Effects of Feedback in CodingBat Exercises: An Exploratory Thinking Aloud Study2023 Future of Educational Innovation-Workshop Series Data in Action10.1109/IEEECONF56852.2023.10104622(1-12)Online publication date: 16-Jan-2023
https://doi.org/10.1109/IEEECONF56852.2023.10104622
Kiesler NKiesler N(2023)Results of Guided Expert InterviewsModeling Programming Competency10.1007/978-3-031-47148-3_9(111-131)Online publication date: 10-Oct-2023
https://doi.org/10.1007/978-3-031-47148-3_9
Kiesler NKiesler N(2023)ConclusionModeling Programming Competency10.1007/978-3-031-47148-3_11(153-165)Online publication date: 10-Oct-2023
https://doi.org/10.1007/978-3-031-47148-3_11
Kiesler NKiesler N(2023)Summarizing and Reviewing the Components of Programming CompetencyModeling Programming Competency10.1007/978-3-031-47148-3_10(133-150)Online publication date: 10-Oct-2023
https://doi.org/10.1007/978-3-031-47148-3_10
Kiesler NKiesler N(2023)IntroductionModeling Programming Competency10.1007/978-3-031-47148-3_1(3-16)Online publication date: 10-Oct-2023
https://doi.org/10.1007/978-3-031-47148-3_1

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents