article

Research in computer science: an empirical study

Authors:

Robert L. Glass,

Iris VesseyAuthors Info & Claims

Journal of Systems and Software, Volume 70, Issue 1-2

Pages 165 - 176

https://doi.org/10.1016/S0164-1212(03)00015-3

Published: 01 February 2004 Publication History

Abstract

In this paper, we examine the state of computer science (CS) research from the point of view of the following research questions:1.What topics do CS researchers address? 2.What research approaches do CS researchers use? 3.What research methods do CS researchers use? 4.On what reference disciplines does CS research depend? 5.At what levels of analysis do CS researchers conduct research? To answer these questions, we examined 628 papers published between 1995 and 1999 in 13 leading research journals in the CS field. Our results suggest that while CS research examines a variety of technical topics it is relatively focused in terms of the level at which research is conducted as well as the research techniques used. Further, CS research seldom relies on work outside the discipline for its theoretical foundations. We present our findings as an evaluation of the state of current research and as groundwork for future CS research efforts.

References

[1]

ACM CCS: ACM Computing Classification System {1998 version}, http://www.acm.org/class/1998, 1998, accessed 11/06/01

[2]

A review of MIS research and disciplinary development: implications for deans/administrators. Journal of Management Information Systems. v8. 45-62.

[3]

An information systems keyword classification scheme. MIS Quarterly. v12 i2. 299-322.

[4]

The evolution of empirical research in IS: a study in IS maturity. Information and Management. v24 i5. 107-119.

[5]

Computer Science research in Mexico. IEEE Computer. v28 i8. 56-62.

[6]

Farhoomand, A.F., Drury, D.H., 2000. A Historiographical Examination of Information Systems. Communication of the AIS Vol. 1, Article 19, 2000

[7]

The role of experiments in Computer Science. Journal of Systems and Software. v30 i1-2. 61-163.

[8]

CSE: content and product. IEEE Computational Science and Engineering. v4 i2. 39-43.

[9]

Computing research programs in the US. Communications of the ACM. v39 i12. 96-99.

[10]

A comparative analysis of the topic areas of Computer Science, Software Engineering, and Information Systems. Journal of Systems and Software. iNovember. 277-289.

[11]

A structure-based critique of contemporary computing research. Journal of Systems and Software. iJanuary.

[12]

Research in software engineering: an analysis of the literature. Information and Software Technology. v44. 491-506.

[13]

Conference tries to define computing-research agenda. IEEE Software. v7 i1. 127-132.

[14]

Harrison, R., Wells, M., 2000. A Meta-Analysis of Multidisciplinary Research. In: Papers from The Conference on Empirical Assessment in Software Engineering (EASE), pp. 1-15

[15]

Semantic database modeling: survey, applications and research issues. ACM Computing Surveys. v19 i3. 201-260.

[16]

Exploring the research in information technology implementation. Information and Management. v32. 187-201.

[17]

Exploring the Software Engineering component in MIS research. Communications of the ACM. v38 i7. 80-91.

[18]

Studying information technology in organizations: research approaches and assumptions. Information Systems Research. v2 i1. 1-28.

[19]

Computer Science research in India. IEEE Computer. 40-47.

[20]

Computational science and the future of computing research. IEEE Computational Science and Engineering. v2 i4. 34-41.

[21]

Federated database systems for managing distributed, heterogeneous, and autonomous databases. ACM Computing Surveys. v22 i3. 183-236.

[22]

Information systems research thematics: submissions to a new journal 1987-1992. Information Systems Research. v4 i4. 299-330.

[23]

Experimental evaluation in computer science: a quantitative study. Journal of Systems and Software. iJanuary.

[24]

Vessey, I, Ramesh, V., Glass, R.L., 2001. Research in Computing Disciplines: A Comprehensive Classification Scheme, Indiana University: Working Paper (TR 107-1), http://www.kelley.iu.edu/ardennis/wp/ (accessed 02/08/02), 2001

[25]

Strategic directions in computing research. ACM Computing Surveys. v28 i4. 565-574.

[26]

Cross-fertilizations of knowledge: the case of MIS and its reference disciplines. Information Resources Management Journal. v7 i2. 24-34.

[27]

Experimental validation in software engineering. Information and Software Technology. v39. 735-743.

Cited By

Hatziapostolou TDranidis DSotiriadou AKefalas PNikolakopoulos IPolycarpou IRead JAndreou PArmoni M(2018)An authentic student research experience: fostering research skills and boosting the employability profile of studentsProceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education10.1145/3197091.3197131(254-259)Online publication date: 2-Jul-2018
https://dl.acm.org/doi/10.1145/3197091.3197131
Vicente-López ECampos LFernández-Luna JHuete JTagua-Jiménez ATur-Vigil C(2015)An automatic methodology to evaluate personalized information retrieval systemsUser Modeling and User-Adapted Interaction10.1007/s11257-014-9148-925:1(1-37)Online publication date: 1-Mar-2015
https://dl.acm.org/doi/10.1007/s11257-014-9148-9
Ko ALaToza TBurnett M(2015)A practical guide to controlled experiments of software engineering tools with human participantsEmpirical Software Engineering10.1007/s10664-013-9279-320:1(110-141)Online publication date: 1-Feb-2015
https://dl.acm.org/doi/10.1007/s10664-013-9279-3
Show More Cited By

Recommendations

Computer Science Teaching Knowledge: A Framework and Assessment (Abstract Only)
SIGCSE '17: Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education

Educators, researchers, politicians, tech companies, and others continue to advocate for the importance of K-12 students learning computer science in our increasingly tech-driven society. One way school districts in the United States address this ...
Computer Science Summer Camps: Making Summer Programs Fun and Sustainable (Abstract Only)
SIGCSE '16: Proceedings of the 47th ACM Technical Symposium on Computing Science Education

Higher education has the opportunity (and often the mandate) to provide STEM outreach to their communities. Summer camp programs are one mechanism for providing quality CS learning experiences to a wide audience. This BOF will provide a platform for ...
Building a Statewide Computer Science Teacher Pipeline
SIGCSE '17: Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education

From 2012 to 2015, the number of Utah secondary teachers teaching computer science courses grew from 38 to 164. This growth was made possible by introducing three new CS teacher endorsements, which reduced the effort required for existing teachers to ...

Comments

Information & Contributors

Information

Published In

cover image Journal of Systems and Software

Journal of Systems and Software Volume 70, Issue 1-2

February, 2004

218 pages

ISSN:0164-1212

Issue’s Table of Contents

Copyright © Elsevier Inc. © 2003.

Publisher

Elsevier Science Inc.

United States

Publication History

Published: 01 February 2004

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hatziapostolou TDranidis DSotiriadou AKefalas PNikolakopoulos IPolycarpou IRead JAndreou PArmoni M(2018)An authentic student research experience: fostering research skills and boosting the employability profile of studentsProceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education10.1145/3197091.3197131(254-259)Online publication date: 2-Jul-2018
https://dl.acm.org/doi/10.1145/3197091.3197131
Vicente-López ECampos LFernández-Luna JHuete JTagua-Jiménez ATur-Vigil C(2015)An automatic methodology to evaluate personalized information retrieval systemsUser Modeling and User-Adapted Interaction10.1007/s11257-014-9148-925:1(1-37)Online publication date: 1-Mar-2015
https://dl.acm.org/doi/10.1007/s11257-014-9148-9
Ko ALaToza TBurnett M(2015)A practical guide to controlled experiments of software engineering tools with human participantsEmpirical Software Engineering10.1007/s10664-013-9279-320:1(110-141)Online publication date: 1-Feb-2015
https://dl.acm.org/doi/10.1007/s10664-013-9279-3
Bargh Mvan Rooij-Peiman ARemijn LChoenni SRutherfoord BLi LVan de Ven SSettle ASteinbach T(2014)Research skills for software engineering undergraduates in dutch universities of applied sciencesProceedings of the 15th Annual Conference on Information technology education10.1145/2656450.2656477(101-108)Online publication date: 14-Oct-2014
https://dl.acm.org/doi/10.1145/2656450.2656477
Tedre MBrash DMännikkö-Barbutiu SCronjé JCajander ÅDaniels MClear TPears A(2014)Towards identification and classification of core and threshold concepts in methodology education in computingProceedings of the 2014 conference on Innovation & technology in computer science education10.1145/2591708.2591758(237-242)Online publication date: 21-Jun-2014
https://dl.acm.org/doi/10.1145/2591708.2591758
Topi H(2013)Student competitions as highly valuable learning experiencesACM Inroads10.1145/2465085.24650934:2(30-31)Online publication date: 1-Jun-2013
https://dl.acm.org/doi/10.1145/2465085.2465093
Clear T(2013)Doctoral work in computing education researchACM Inroads10.1145/2465085.24650924:2(28-30)Online publication date: 1-Jun-2013
https://dl.acm.org/doi/10.1145/2465085.2465092
Stuckenschmidt HSchuhmacher MKnopp JMeilicke CScherp A(2013)On the Status of Experimental Research on the Semantic WebProceedings of the 12th International Semantic Web Conference - Part I10.1007/978-3-642-41335-3_37(591-606)Online publication date: 21-Oct-2013
https://dl.acm.org/doi/10.1007/978-3-642-41335-3_37
Kaskenpalo PMacDonell SZhang HYang YBabar M(2012)Valuing evaluationProceedings of the 2nd international workshop on Evidential assessment of software technologies10.1145/2372233.2372242(27-32)Online publication date: 22-Sep-2012
https://dl.acm.org/doi/10.1145/2372233.2372242
Tamine-Lechani LBoughanem MDaoud M(2010)Evaluation of contextual information retrieval effectivenessKnowledge and Information Systems10.5555/3225651.322589124:1(1-34)Online publication date: 1-Jul-2010
https://dl.acm.org/doi/10.5555/3225651.3225891
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents