skip to main content
10.1145/2505515.2505610acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Assessing quality score of Wikipedia article using mutual evaluation of editors and texts

Published: 27 October 2013 Publication History

Abstract

In this paper, we propose a method for assessing quality scores of Wikipedia articles by mutually evaluating editors and texts. Survival ratio based approach is a major approach to assessing article quality. In this approach, when a text survives beyond multiple edits, the text is assessed as good quality, because poor quality texts have a high probability of being deleted by editors. However, many vandals, low quality editors, delete good quality texts frequently, which improperly decreases the survival ratios of good quality texts. As a result, many good quality texts are unfairly assessed as poor quality. In our method, we consider editor quality score for calculating text quality score, and decrease the impact on text quality by vandals. Using this improvement, the accuracy of the text quality score should be improved. However, an inherent problem with this idea is that the editor quality scores are calculated by the text quality scores. To solve this problem, we mutually calculate the editor and text quality scores until they converge. In this paper, we prove that the text quality score converges. We did our experimental evaluation, and confirmed that our proposed method could accurately assess the text quality scores.

References

[1]
Adler, B., Chatterjee, K., de Alfaro, L., Faella, M., Pye, I., and Raman, V. Measuring Author Contributions to the Wikipedia. In Proceedings of the 2008 International Symposium on Wikis (WikiSym '08) (2008).
[2]
Adler, B., and de Alfaro, L. A content-driven reputation system for the Wikipedia. In Proceedings of the 16th international conference on World Wide Web (WWW '07) (2007), pp. 261--270.
[3]
Adler, B. T., Chatterjee, K., de Alfaro, L., Faella, M., Pye, I., and Raman, V. Assigning Trust to Wikipedia Content. In Proceedings of the International Symposium on Wikis (WikiSym '08) (2008), ACM.
[4]
Baeza-Yates, R., and Ribeiro-Neto, B. Modern Information Retrieval: the concepts and technology behind search. Addison-Wesley, 2011.
[5]
Hu, M., Lim, E., Sun, A., Lauw, H. W., and Vuong, B. Measuring Article Quality in Wikipedia: Models and Evaluation. In Proceedings of ACM International Conference on Information and Knowledge Management (CIKM 2007) (2007), pp. 243--252.
[6]
Toms, E. G., Mackenzie, T., Jordan, C., and Hall, S. wikiSearch: enabling interactivity in search. In Proceedings of the 32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2009) (2009), p. 843.
[7]
Wilkinson, D. M., and Huberman, B. A. Cooperation and quality in wikipedia. In Proceedings of the 2007 international symposium on Wikis (WikiSym'07) (2007), ACM, pp. 157--164.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
CIKM '13: Proceedings of the 22nd ACM international conference on Information & Knowledge Management
October 2013
2612 pages
ISBN:9781450322638
DOI:10.1145/2505515
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2013

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. edit history
  2. peer review
  3. quality
  4. vandalism
  5. wikipedia

Qualifiers

  • Research-article

Conference

CIKM'13
Sponsor:
CIKM'13: 22nd ACM International Conference on Information and Knowledge Management
October 27 - November 1, 2013
California, San Francisco, USA

Acceptance Rates

CIKM '13 Paper Acceptance Rate 143 of 848 submissions, 17%;
Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)0
Reflects downloads up to 03 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media