research-article

A detector for non-literal Java errors

Authors:

Thomas Dy,

Ma. Mercedes RodrigoAuthors Info & Claims

Koli Calling '10: Proceedings of the 10th Koli Calling International Conference on Computing Education Research

Pages 118 - 122

https://doi.org/10.1145/1930464.1930485

Published: 28 October 2010 Publication History

Get Access

Abstract

Novice programmers typically have problems diagnosing errors in their programs. This difficulty may be attributed in part to non-literal error messages, i.e. compiler-reported errors that do not match the actual error. Through the analysis of compilation logs, we determined the errors frequently committed by novice programmers. We then developed a detector that checks novice student code for these non-literal errors and produces more informative error reports.

References

[1]

M. Ahmadzadeh, D. Elliman, and C. Higgins. An analysis of patterns of debugging among novice computer science students. In ITiCSE '05: Proceedings of the 10th annual SIGCSE conference on Innovation and technology in computer science education, pages 84--88, New York, NY, USA, 2005. ACM.

Digital Library

Google Scholar

[2]

N. Coull, I. Duncan, J. Archibald, and G. Lund. Helping novice programmers interpret compiler error messages. In 4th Annual LTSN-ICS Conference. National University of Ireland, Galway. (August, 2003), pages 26--28.

Google Scholar

[3]

C. Csallner and Y. Smaragdakis. Check 'n' crash: combining static checking and testing. In ICSE '05: Proceedings of the 27th international conference on Software engineering, pages 422--431, New York, NY, USA, 2005. ACM.

Digital Library

Google Scholar

[4]

T. T. Dy, E. J. D. Robles, and M. M. T. Rodrigo. Detection of non-literal java errors in an introductory programming class. In 2010 Philippine Computing Society Congress, Ateneo de Davao, 2010.

Google Scholar

[5]

A. Ebrahimi, D. Kopec, and C. Schweikert. Taxonomy of novice programming errors with plan, web, and object solutions. ACM, Computing Surveys, December 2006.

Google Scholar

[6]

M. Hristova, A. Misra, M. Rutter, and R. Mercuri. Identifying and correcting java programming errors for introductory computer science students. In SIGCSE '03: Proceedings of the 34th SIGCSE technical symposium on Computer science education, pages 153--156, New York, NY, USA, 2003. ACM.

Digital Library

Google Scholar

[7]

M. C. Hughes, M. C. Jadud, and M. M. T. Rodrigo. Novice programmer strategies for string formatting. Unpublished.

Google Scholar

[8]

M. Jadud. Methods and tools for exploring novice compilation behaviour. In Proceedings of the second international workshop on Computing education research, pages 73--84. ACM New York, NY, USA, 2006.

Digital Library

Google Scholar

[9]

W. Johnson. Understanding and debugging novice programs. Artificial Intelligence and Learning Environments, MIT Press, Cambridge, MA, pages 51--97, 1990.

Digital Library

Google Scholar

[10]

W. L. Johnson and E. Soloway. Proust: Knowledge-based program understanding. In ICSE '84: Proceedings of the 7th international conference on Software engineering, pages 369--380, Piscataway, NJ, USA, 1984. IEEE Press.

Digital Library

Google Scholar

[11]

L. Murphy, G. Lewandowski, R. McCauley, B. Simon, L. Thomas, and C. Zander. Debugging: the good, the bad, and the quirky -- a qualitative analysis of novices' strategies. In SIGCSE '08: Proceedings of the 39th SIGCSE technical symposium on Computer science education, pages 163--167, New York, NY, USA, 2008. ACM.

Digital Library

Google Scholar

[12]

M. M. T. Rodrigo, E. Tabanao, M. B. E. Lahoz, and M. C. Jadud. Analyzing online protocols to characterize novice java programmers. Philippine Journal of Science, 138(2):177--199, 2009.

Google Scholar

[13]

N. Truong, P. Roe, and P. Bancroft. Static analysis of students' java programs. In ACE '04: Proceedings of the sixth conference on Australasian computing education, pages 317--325, Darlinghurst, Australia, Australia, 2004. Australian Computer Society, Inc.

Digital Library

Google Scholar

Cited By

View all

Kaur HKaur KKaur K(2024)Enhancing student experience in remote computer programming course practice: A case of the Java languageE-Learning and Digital Media10.1177/20427530241262485Online publication date: 14-Jun-2024
https://doi.org/10.1177/20427530241262485
Bouvier DLovellette ESantos EBecker BDasigi VForden JGlebova OJoshi SKurkovsky SRussell SChoppella VPhatak DLuxton-Reilly ACraig M(2024)Teaching Programming Error Message UnderstandingWorking Group Reports on 2023 ACM Conference on Global Computing Education10.1145/3598579.3689377(1-30)Online publication date: 23-Sep-2024
https://dl.acm.org/doi/10.1145/3598579.3689377
Pacol CRodrigo MTablatin C(2024)A Comparative Study of High and Low Performing Students’ Visual Effort and Attention When Identifying Syntax ErrorsAugmented Cognition10.1007/978-3-031-61569-6_6(77-94)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-61569-6_6
Show More Cited By

Index Terms

A detector for non-literal Java errors

Recommendations

A New Look at Novice Programmer Errors
Special Section on ML Education and Regular Articles

The types of programming errors that novice programmers make and struggle to resolve have long been of interest to researchers. Various past studies have analyzed the frequency of compiler diagnostic messages. This information, however, does not have a ...
Always Provide Context: The Effects of Code Context on Programming Error Message Enhancement
CompEd 2023: Proceedings of the ACM Conference on Global Computing Education Vol 1

Programming error messages (PEMs) are notoriously difficult for novice programmers to utilise. Many efforts have been made to enhance PEMs such that they are reworded to explain problems in terms that novices can understand. However, the effectiveness of ...
The Future of the Error Message: Comparing Large Language Models and Novice Programmer Effectiveness in Fixing Errors
SIGCSE 2024: Proceedings of the 55th ACM Technical Symposium on Computer Science Education V. 2

Research on enhancing error message presentation is of great interest to teachers and developers alike because improving Integrated Development Environments (IDEs) increases early student retention and efficiency at all levels with more effective ...

Comments

Information & Contributors

Information

Published In

Koli Calling '10: Proceedings of the 10th Koli Calling International Conference on Computing Education Research

October 2010

125 pages

ISBN:9781450305204

DOI:10.1145/1930464

Conference Chairs:
Carsten Schulte,
Jarkko Suhonen

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGCSE: ACM Special Interest Group on Computer Science Education

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 October 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

Koli Calling '10

Sponsor:

FU-BERLIN

Koli Calling '10: 10th Koli Calling International Conference on Computing Education Research

October 28 - 31, 2010

Koli, Finland

Acceptance Rates

Overall Acceptance Rate 80 of 182 submissions, 44%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
294
Total Downloads

Downloads (Last 12 months)16
Downloads (Last 6 weeks)2

Reflects downloads up to 26 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kaur HKaur KKaur K(2024)Enhancing student experience in remote computer programming course practice: A case of the Java languageE-Learning and Digital Media10.1177/20427530241262485Online publication date: 14-Jun-2024
https://doi.org/10.1177/20427530241262485
Bouvier DLovellette ESantos EBecker BDasigi VForden JGlebova OJoshi SKurkovsky SRussell SChoppella VPhatak DLuxton-Reilly ACraig M(2024)Teaching Programming Error Message UnderstandingWorking Group Reports on 2023 ACM Conference on Global Computing Education10.1145/3598579.3689377(1-30)Online publication date: 23-Sep-2024
https://dl.acm.org/doi/10.1145/3598579.3689377
Pacol CRodrigo MTablatin C(2024)A Comparative Study of High and Low Performing Students’ Visual Effort and Attention When Identifying Syntax ErrorsAugmented Cognition10.1007/978-3-031-61569-6_6(77-94)Online publication date: 1-Jun-2024
https://doi.org/10.1007/978-3-031-61569-6_6
Evans AWang ZLiu JZheng MLaakso MMonga MSimon Sheard J(2023)SIDE-lib: A Library for Detecting Symptoms of Python Programming MisconceptionsProceedings of the 2023 Conference on Innovation and Technology in Computer Science Education V. 110.1145/3587102.3588838(159-165)Online publication date: 29-Jun-2023
https://dl.acm.org/doi/10.1145/3587102.3588838
Hellas ALeinonen JSarsa SKoutcheme CKujanpää LSorva J(2023)Exploring the Responses of Large Language Models to Beginner Programmers’ Help RequestsProceedings of the 2023 ACM Conference on International Computing Education Research - Volume 110.1145/3568813.3600139(93-105)Online publication date: 7-Aug-2023
https://dl.acm.org/doi/10.1145/3568813.3600139
Koutcheme CSarsa SLeinonen JHaaranen LHellas A(2023)Evaluating Distance Measures for Program RepairProceedings of the 2023 ACM Conference on International Computing Education Research - Volume 110.1145/3568813.3600130(495-507)Online publication date: 7-Aug-2023
https://dl.acm.org/doi/10.1145/3568813.3600130
Rodrigo MTablatin C(2023)How Do Programming Students Read and Act upon Compiler Error Messages?Augmented Cognition10.1007/978-3-031-35017-7_11(153-168)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35017-7_11
Jemmali CSeif El-Nasr MCooper S(2022)The Effects of Adaptive Procedural Levels on Engagement and Performance in an Educational Programming GameProceedings of the 17th International Conference on the Foundations of Digital Games10.1145/3555858.3555892(1-12)Online publication date: 5-Sep-2022
https://dl.acm.org/doi/10.1145/3555858.3555892
Caton SRussell SBecker BMerkle LDoyle MSheard JSoh LDorn B(2022)What Fails Once, Fails AgainProceedings of the 53rd ACM Technical Symposium on Computer Science Education - Volume 110.1145/3478431.3499419(955-961)Online publication date: 22-Feb-2022
https://dl.acm.org/doi/10.1145/3478431.3499419
Becker BDenny PPettit RBouchard DBouvier DHarrington BKamil AKarkare AMcDonald COsera PPearce JPrather JRößling GGiannakos MScharlau BMcDermott RPears ASabin M(2019)Compiler Error Messages Considered UnhelpfulProceedings of the Working Group Reports on Innovation and Technology in Computer Science Education10.1145/3344429.3372508(177-210)Online publication date: 18-Dec-2019
https://dl.acm.org/doi/10.1145/3344429.3372508
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

A New Look at Novice Programmer Errors

Always Provide Context: The Effects of Code Context on Programming Error Message Enhancement

The Future of the Error Message: Comparing Large Language Models and Novice Programmer Effectiveness in Fixing Errors

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations