research-article

Identifying controversial articles in Wikipedia: a comparative study

Authors:

Hoda Sepehri Rad,

Denilson BarbosaAuthors Info & Claims

WikiSym '12: Proceedings of the Eighth Annual International Symposium on Wikis and Open Collaboration

Article No.: 7, Pages 1 - 10

https://doi.org/10.1145/2462932.2462942

Published: 27 August 2012 Publication History

Abstract

Wikipedia articles are the result of the collaborative editing of a diverse group of anonymous volunteer editors, who are passionate and knowledgeable about specific topics. One can argue that this plurality of perspectives leads to broader coverage of the topic, thus benefitting the reader. On the other hand, differences among editors on polarizing topics can lead to controversial or questionable content, where facts and arguments are presented and discussed to support a particular point of view. Controversial articles are manually tagged by Wikipedia editors, and span many interesting and popular topics, such as religion, history, and politics, to name a few. Recent works have been proposed on automatically identifying controversy within unmarked articles. However, to date, no systematic comparison of these efforts has been made. This is in part because the various methods are evaluated using different criteria and on different sets of articles by different authors, making it hard for anyone to verify the efficacy and compare all alternatives. We provide a first attempt at bridging this gap. We compare five different methods for modelling and identifying controversy, and discuss some of the unique difficulties and opportunities inherent to the way Wikipedia is produced.

References

[1]

B. T. Adler, K. Chatterjee, L. de Alfaro, M. Faella, I. Pye, and V. Raman. Assigning trust to Wikipedia content. In proceedings of the 4th international Symposium on Wikis, pages 1--12. ACM, 2008.

Digital Library

[2]

E. M. Bender, J. T. Morgan, M. Oxley, M. Zachry, B. Hutchinson, A. Marin, B. Zhang, and M. Ostendorf. Annotating social acts: authority claims and alignment moves in Wikipedia talk pages. In proceedings of workshop on Languages in Social Media, pages 48--57. ACL, 2011.

Digital Library

[3]

U. Brandes, P. Kenis, J. Lerner, and D. van Raaij. Network analysis of collaboration structure in Wikipedia. In proceedings of the 18th international conference on World Wide Web, pages 731--740. ACM, 2009.

Digital Library

[4]

U. Brandes and J. Lerner. Visual analysis of controversy in user-generated encyclopedias. Information Visualization, 7(1):34--48, 2008.

Digital Library

[5]

U. Brandes and J. Lerner. Is editing more rewarding than discussion? a statistical framework to estimate causes of dropout from Wikipedia. In proceedings of workshop on Motivation and Incentives. ACM, 2009.

[6]

Y. Choi, Y. Jung, and S.-H. Myaeng. Identifying controversial issues and their sub-topics in news articles. In proceedings of Pacific Asia workshop on Intelligence and Security Informatics, pages 140--153. Springer, 2010.

Digital Library

[7]

F. Flöck, D. Vrandečić, and E. Simperl. Towards a diversity-minded Wikipedia. In proceedings of the 3rd international conference on Web Science. ACM, 2011.

Digital Library

[8]

K. Hajian-Tilaki, J. Hanley, L. Joseph, and J.-P. Collet. A comparison of parametric and non-parametric approaches to roc analysis of quantitative diagnostic tests. Medical Decision Making, 17(1):94--102, 1997.

[9]

A. Hassan, V. Qazvinian, and D. Radev. What's with the attitude?: identifying sentences with attitude in online discussions. In proceedings of international conference on Empirical Methods in Natural Language Processing, pages 1245--1255. ACL, 2010.

Digital Library

[10]

M. Hu, E.-P. Lim, A. Sun, H. W. Lauw, and B.-Q. Vuong. Measuring article quality in Wikipedia: models and evaluation. In proceedings of the 16th international conference on Information and Knowledge Management, pages 243--252. ACM, 2007.

Digital Library

[11]

D. Jurgens and T.-C. Lu. Temporal motifs reveal the dynamics of editor interactions in Wikipedia. In proceedings of the 6th international conference on Weblogs and Social Media. AAAI, 2012.

[12]

A. Kittur, B. Suh, and E. H. Chi. Can you ever trust a wiki?: impacting perceived trustworthiness in Wikipedia. In proceedings of the 13th international conference on Computer Supported Cooperative Work, pages 477--480. ACM, 2008.

Digital Library

[13]

A. Kittur, B. Suh, B. A. Pendleton, and E. H. Chi. He says, she says: conflict and coordination in Wikipedia. In proceedings of the 25th international conference on Computer/Human Interaction, pages 453--462. ACM, 2007.

Digital Library

[14]

J. Leskovec, D. Huttenlocher, and J. Kleinberg. Predicting positive and negative links in online social networks. In proceedings of the 20th international conference on World Wide Web, pages 641--650. ACM, 2010.

Digital Library

[15]

C. Li, A. Datta, and A. Sun. Mining latent relations in peer-production environments: a case study with Wikipedia article similarity and controversy. Social Network Analysis and Mining, pages 1--14, 2011.

[16]

J. Schneider, A. Passant, and J. Breslin. A qualitative and quantitative analysis of how Wikipedia talk pages are used. In proceedings of the 2nd international conference on WebScience, pages 1--7. ACM, 2010.

[17]

H. Sepehri Rad and D. Barbosa. Towards identifying arguments in Wikipedia pages. In proceedings of 20th international conference on World Wide Web: Posters, pages 117--118. ACM, 2011.

Digital Library

[18]

H. Sepehri Rad, A. Makazhanov, D. Rafiei, and D. Barbosa. Leveraging editor collaboration patterns in Wikipedia. In proceedings of the 23rd international conference on Hypertext and Social Media, pages 13--22. ACM, 2012.

Digital Library

[19]

S. Somasundaran and J. Wiebe. Recognizing stances in online debates. In proceedings of the 47th annual meeting of the ACL, pages 226--234. ACL, 2009.

Digital Library

[20]

B. Suh, E. H. Chi, B. A. Pendleton, and A. Kittur. Us vs. them: Understanding social dynamics in Wikipedia with revert graph visualizations. In proceedings of the 2nd international conference on Visual Analytics Science and Technology, pages 163--170. IEEE, 2007.

Digital Library

[21]

R. S. Sumi, T. Yasseri, A. Rung, A. Kornai, and J. Kertész. Edit wars in Wikipedia. In proceedings of the 3rd international conference on Social Computing, pages 724--727. IEEE, 2011.

[22]

B.-Q. Vuong, E.-P. Lim, A. Sun, M.-T. Le, and H. W. Lauw. On ranking controversies in Wikipedia: models and evaluation. In proceedings of the 1st international conference on Web Search and Data Mining, pages 171--182. ACM, 2008.

Digital Library

[23]

H. Zeng, M. A. Alhossaini, L. Ding, R. Fikes, and D. L. McGuinness. Computing trust from revision history. In proceedings of the 4th international conference on Privacy, Security and Trust, pages 1--8. IEEE, 2006.

Digital Library

Cited By

Santos VSchwabe DLifschitz S(2024)Can you trust Wikidata?Semantic Web10.3233/SW-243577(1-22)Online publication date: 7-Mar-2024
https://doi.org/10.3233/SW-243577
Laniado DMauri MBorra E(2024)Chapter 6. Exploring the evolution of Wikipedia articles through ContropediaInvestigating Wikipedia10.1075/scl.121.06lan(156-177)Online publication date: 25-Oct-2024
https://doi.org/10.1075/scl.121.06lan
Koncar PWalk SHelic D(2021)Analysis and Prediction of Multilingual Controversy on RedditProceedings of the 13th ACM Web Science Conference 202110.1145/3447535.3462481(215-224)Online publication date: 21-Jun-2021
https://dl.acm.org/doi/10.1145/3447535.3462481
Show More Cited By

Index Terms

Identifying controversial articles in Wikipedia: a comparative study
1. Information systems
  1. Information systems applications

Recommendations

Societal Controversies in Wikipedia Articles
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

Collaborative content creation inevitably reaches situations where different points of view lead to conflict. We focus on Wikipedia, the free encyclopedia anyone may edit, where disputes about content in controversial articles often reflect larger ...
Towards identifying arguments in Wikipedia pages
WWW '11: Proceedings of the 20th international conference companion on World wide web

Wikipedia is one of the most widely used repositories of human knowledge today, contributed mostly by a few hundred thousand regular editors. In this open environment, inevitably, differences of opinion arise among editors of the same article. ...
Extracting structured information from Wikipedia articles to populate infoboxes
CIKM '10: Proceedings of the 19th ACM international conference on Information and knowledge management

Roughly every third Wikipedia article contains an infobox - a table that displays important facts about the subject in attribute-value form. The schema of an infobox, i.e., the attributes that can be expressed for a concept, is defined by an infobox ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WikiSym '12: Proceedings of the Eighth Annual International Symposium on Wikis and Open Collaboration

August 2012

295 pages

ISBN:9781450316057

DOI:10.1145/2462932

General Chair:
Cliff Lampe
University of Michigan, Ann Arbor, MI

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web
TJEF: The John Ernest Foundation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 August 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Natural Sciences and Engineering Research Council of Canada

Conference

WikiSym '12

Sponsor:

SIGWEB

WikiSym '12: The 8th International Symposium on Wikis

August 27 - 29, 2012

Linz, Austria

Acceptance Rates

WikiSym '12 Paper Acceptance Rate 21 of 37 submissions, 57%;

Overall Acceptance Rate 69 of 145 submissions, 48%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
362
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Santos VSchwabe DLifschitz S(2024)Can you trust Wikidata?Semantic Web10.3233/SW-243577(1-22)Online publication date: 7-Mar-2024
https://doi.org/10.3233/SW-243577
Laniado DMauri MBorra E(2024)Chapter 6. Exploring the evolution of Wikipedia articles through ContropediaInvestigating Wikipedia10.1075/scl.121.06lan(156-177)Online publication date: 25-Oct-2024
https://doi.org/10.1075/scl.121.06lan
Koncar PWalk SHelic D(2021)Analysis and Prediction of Multilingual Controversy on RedditProceedings of the 13th ACM Web Science Conference 202110.1145/3447535.3462481(215-224)Online publication date: 21-Jun-2021
https://dl.acm.org/doi/10.1145/3447535.3462481
Ashford JTurner LWhitaker RPreece AFelmlee DTowsley D(2019)Understanding the Signature of Controversial Wikipedia Articles through Motifs in Editor Revision NetworksCompanion Proceedings of The 2019 World Wide Web Conference10.1145/3308560.3316754(1180-1187)Online publication date: 13-May-2019
https://dl.acm.org/doi/10.1145/3308560.3316754
Spezzano FSuyehira KGundala L(2019)Detecting pages to protect in Wikipedia across multiple languagesSocial Network Analysis and Mining10.1007/s13278-019-0555-09:1Online publication date: 14-Mar-2019
https://doi.org/10.1007/s13278-019-0555-0
Jemielniak DWilamowski M(2017)Cultural diversity of quality of information on WikipediasJournal of the Association for Information Science and Technology10.5555/3204593.320460768:10(2460-2470)Online publication date: 1-Oct-2017
https://dl.acm.org/doi/10.5555/3204593.3204607
Jang MDori-Hacohen SAllan JKamps JKanoulas Ede Rijke MFang HYilmaz E(2017)Modeling Controversy within PopulationsProceedings of the ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3121050.3121067(141-149)Online publication date: 1-Oct-2017
https://dl.acm.org/doi/10.1145/3121050.3121067
Al Tamime RMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Behind The Wikipedia Medical Knowledge FactoryProceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/3027063.3027119(238-243)Online publication date: 6-May-2017
https://dl.acm.org/doi/10.1145/3027063.3027119
Pentzold CWeltevrede EMauri MLaniado DKaltenbrunner ABorra E(2017)Digging WikipediaJournal on Computing and Cultural Heritage 10.1145/301228510:1(1-19)Online publication date: 10-Mar-2017
https://dl.acm.org/doi/10.1145/3012285
Jhandir MTenvir AOn BLee IChoi G(2017)Controversy detection in Wikipedia using semantic dissimilarityInformation Sciences: an International Journal10.1016/j.ins.2017.08.037418:C(581-600)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1016/j.ins.2017.08.037
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents