research-article

Comparative evaluation of text- and citation-based plagiarism detection approaches using guttenplag

Authors:

Norman Meuschke,

Joeran BeelAuthors Info & Claims

JCDL '11: Proceedings of the 11th annual international ACM/IEEE joint conference on Digital libraries

Pages 255 - 258

https://doi.org/10.1145/1998076.1998124

Published: 13 June 2011 Publication History

Abstract

Various approaches for plagiarism detection exist. All are based on more or less sophisticated text analysis methods such as string matching, fingerprinting or style comparison. In this paper a new approach called Citation-based Plagiarism Detection is evaluated using a doctoral thesis, in which a volunteer crowd-sourcing project called GuttenPlag identified substantial amounts of plagiarism through careful manual inspection. This new approach is able to identify similar and plagiarized documents based on the citations used in the text. It is shown that citation-based plagiarism detection performs significantly better than text-based procedures in identifying strong paraphrasing, translation and some idea plagiarism. Detection rates can be improved by combining citation-based with text-based plagiarism detection.

References

[1]

Guttenplag wiki. Online Resource, 2011. Retrieved Apr. 10, 2011 from http://de.guttenplag.wikia.com.

[2]

BLOOMFIELD, L. A. The Plagiarism Resource Site. Online Resource, 2011. Retrieved Mar. 20, 2011 from http://www.plagiarism.phys.virginia.edu.

[3]

CLOUGH, P. Plagiarism in natural and programming languages an overview of current tools and technologies. Tech. rep., Department of Computer Science, University of Sheffield, July 2000.

[4]

COCEL. Concise Oxford Companion to the English Language. Oxford Reference Online. Oxford University Press, 1998.

[5]

FRÖHLICH, G. Plagiate und unethische Autorenschaften. Information - Wissenschaft & Praxis 57, 2 (2006), 81--89.

[6]

GARFIELD, E. Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas. Science 122, 3159 (July 1955), 108--111.

[7]

GIPP, B., AND BEEL, J. Citation Based Plagiarism Detection - A New Approach to Identify Plagiarized Work Language Independently. In Proceedings of the 21st ACM Conference on Hyptertext and Hypermedia (HT'10) (New York, USA, June 2010), ACM, pp. 273--274.

Digital Library

[8]

GUTTENBERG, K.-T. F. Verfassung und Verfassungsvertrag : Konstitutionelle Entwicklungsstufen in den USA und der EU. Dissertation (Retracted as plagiarism), Universität Bayreuth, Berlin, 2009.

[9]

HOAD, T. C., AND ZOBEL, J. Methods for Identifying Versioned and Plagiarised Documents. Journal of the American Society for Information Science and Technology 54, 3 (2003), 203--215.

Digital Library

[10]

HOCHSCHULE FÜR TECHNIK UND WIRTSCHAFT BERLIN. Portal Plagiat - Test von Plagiatserkennungssoftware. Online Resource. Retrieved Apr. 08, 2011 from http://plagiat.htw-berlin.de/software/.

[11]

LYON, C., MALCOLM, J., AND DICKERSON, B. Detecting Short Passages of Similar Text in Large Document Collections. In Proceedings of the 2001 Conference on Empirical Methods in Natural Language Processing (2001), L. Lee and D. Harman, Eds., pp. 118--125.

[12]

MAURER, H., KAPPE, F., AND ZAKA, B. Plagiarism - A Survey. Journal of Universal Computer Science 12, 8 (Aug. 2006), 1050--1084.

[13]

MONOSTORI, K., ZASLAVSKY, A., AND SCHMIDT, H. Document Overlap Detection System for Distributed Digital Libraries. In DL '00: Proceedings of the fifth ACM conference on Digital libraries (New York, NY, USA, 2000), ACM, pp. 226--227.

Digital Library

[14]

POTTHAST, M., BARRÓN-CEDEÑO, A., EISELT, A., STEIN, B., AND ROSSO, P. Overview of the 2nd international competition on plagiarism detection. In Notebook Papers of CLEF 2010 LABs and Workshops, 22--23 September, Padua, Italy (Sept. 2010), M. Braschler, D. Harman, and E. Pianta, Eds.

[15]

POTTHAST, M., STEIN, B., BARRÓN-CEDEÑO, A., AND ROSSO, P. An evaluation framework for plagiarism detection. In Proceedings of the 23rd International Conference on Computational Linguistics (COLING 2010) (Block A, Xue Yan Building, Tsinghua University, Beijing 100084, China, Aug. 2010), C.-R. Huang and D. Jurafsky, Eds., Tsinghua University Press.

Digital Library

[16]

RUDMAN, J. The state of authorship attribution studies: Some problems and solutions. Computers and the Humanities 31 (1997), 351--365.

[17]

STEIN, B., KOPPEL, M., AND STAMATATOS, E., Eds. Proceedings of the SIGIR 2007 International Workshop on Plagiarism Analysis, Authorship Identification, and Near Duplicate Detection, PAN 2007, Amsterdam, Netherlands, July 27, 2007 (2007), vol. 276 of CEUR Workshop Proceedings, CEUR-WS.org.

[18]

STEIN, B., LIPKA, N., AND PRETTENHOFER, P. Intrinsic Plagiarism Analysis. Language Resources and Evaluation (2010), 1--20.

Digital Library

[19]

SUN, Z., ERRAMI, M., LONG, T., RENARD, C., CHORADIA, N., AND GARNER, H. Systematic characterizations of text similarity in full text biomedical publications. PLoS ONE 5, 9 (Sept. 2010), e12704.

[20]

WEBER-WULFF, D. Test cases for plagiarism detection software. In Proceedings of the 4th International Plagiarism Conference (Newcastle Upon Tyne, 2010).

Cited By

Tang JSun GChen JZhang GChang BWang HLiang R(2024)MAVIDSQL: A Model-Agnostic Visualization for Interpretation and Diagnosis of Text-to-SQL TasksIEEE Transactions on Cognitive and Developmental Systems10.1109/TCDS.2024.339127816:5(1887-1903)Online publication date: Oct-2024
https://doi.org/10.1109/TCDS.2024.3391278
Jambi KKhan ISiddiqui M(2022)Evaluation of Different Plagiarism Detection Methods: A Fuzzy MCDM PerspectiveApplied Sciences10.3390/app1209458012:9(4580)Online publication date: 30-Apr-2022
https://doi.org/10.3390/app12094580
Yousef TJanicke S(2021)A Survey of Text Alignment VisualizationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.302897527:2(1149-1159)Online publication date: Feb-2021
https://doi.org/10.1109/TVCG.2020.3028975
Show More Cited By

Index Terms

Comparative evaluation of text- and citation-based plagiarism detection approaches using guttenplag
1. Information systems
  1. Information retrieval
    1. Information retrieval query processing
    2. Retrieval tasks and goals
  2. Information systems applications
    1. Data mining
      1. Clustering

Recommendations

Citation based plagiarism detection: a new approach to identify plagiarized work language independently
HT '10: Proceedings of the 21st ACM conference on Hypertext and hypermedia

This paper describes a new approach towards detecting plagiarism and scientific documents that have been read but not cited. In contrast to existing approaches, which analyze documents' words but ignore their citations, this approach is based on ...
Citation pattern matching algorithms for citation-based plagiarism detection: greedy citation tiling, citation chunking and longest common citation sequence
DocEng '11: Proceedings of the 11th ACM symposium on Document engineering

Plagiarism Detection Systems have been developed to locate instances of plagiarism e.g. within scientific papers. Studies have shown that the existing approaches deliver reasonable results in identifying copy&paste plagiarism, but fail to detect more ...
Demonstration of citation pattern analysis for plagiarism detection
SIGIR '13: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

JCDL '11: Proceedings of the 11th annual international ACM/IEEE joint conference on Digital libraries

June 2011

500 pages

ISBN:9781450307444

DOI:10.1145/1998076

General Chair:
Glen Newton
Carleton University, Canada
,
Program Chairs:
Michael Wright
UCAR/NCAR, USA
,
Lillian Cassel
Villanova University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

JCDL '11

Sponsor:

JCDL '11: Joint Conference on Digital Libraries

June 13 - 17, 2011

Ontario, Ottawa, Canada

Acceptance Rates

Overall Acceptance Rate 415 of 1,482 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
470
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)2

Reflects downloads up to 14 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tang JSun GChen JZhang GChang BWang HLiang R(2024)MAVIDSQL: A Model-Agnostic Visualization for Interpretation and Diagnosis of Text-to-SQL TasksIEEE Transactions on Cognitive and Developmental Systems10.1109/TCDS.2024.339127816:5(1887-1903)Online publication date: Oct-2024
https://doi.org/10.1109/TCDS.2024.3391278
Jambi KKhan ISiddiqui M(2022)Evaluation of Different Plagiarism Detection Methods: A Fuzzy MCDM PerspectiveApplied Sciences10.3390/app1209458012:9(4580)Online publication date: 30-Apr-2022
https://doi.org/10.3390/app12094580
Yousef TJanicke S(2021)A Survey of Text Alignment VisualizationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.302897527:2(1149-1159)Online publication date: Feb-2021
https://doi.org/10.1109/TVCG.2020.3028975
Çano EBojar O(2020)How Many Pages?Proceedings of the 4th International Conference on Natural Language Processing and Information Retrieval10.1145/3443279.3443305(91-95)Online publication date: 18-Dec-2020
https://dl.acm.org/doi/10.1145/3443279.3443305
Khan NAgrawal CYadav H(2020)An Effective Compressive Sensing based N-gram Approach for plagiarism detection2nd International Conference on Data, Engineering and Applications (IDEA)10.1109/IDEA49133.2020.9170683(1-7)Online publication date: Feb-2020
https://doi.org/10.1109/IDEA49133.2020.9170683
Ruthia NTiwary A(2020)An Advance Approach for Spam Document Detection Using QAP Rabin-Karp AlgorithmSocial Networking and Computational Intelligence10.1007/978-981-15-2071-6_25(305-312)Online publication date: 22-Mar-2020
https://doi.org/10.1007/978-981-15-2071-6_25
Foltýnek TMeuschke NGipp B(2019)Academic Plagiarism DetectionACM Computing Surveys10.1145/334531752:6(1-42)Online publication date: 16-Oct-2019
https://dl.acm.org/doi/10.1145/3345317
Meuschke NStange VSchubotz MKramer MGipp BDownie SZhu QHahn J(2019)Improving academic plagiarism detection for STEM documents by analyzing mathematical content and citationsProceedings of the 18th Joint Conference on Digital Libraries10.1109/JCDL.2019.00026(120-129)Online publication date: 2-Jun-2019
https://dl.acm.org/doi/10.1109/JCDL.2019.00026
Bensalem IRosso PChikhi S(2019)On the use of character n-grams as the only intrinsic evidence of plagiarismLanguage Resources and Evaluation10.1007/s10579-019-09444-w53:3(363-396)Online publication date: 1-Sep-2019
https://dl.acm.org/doi/10.1007/s10579-019-09444-w
Gañan D(2019)Plagiarism DetectionEngineering Data-Driven Adaptive Trust-based e-Assessment Systems10.1007/978-3-030-29326-0_2(19-40)Online publication date: 19-Oct-2019
https://doi.org/10.1007/978-3-030-29326-0_2
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents