research-article

Language-agnostic Topic Classification for Wikipedia

Authors:

Martin Gerlach,

Diego Sáez-TrumperAuthors Info & Claims

WWW '21: Companion Proceedings of the Web Conference 2021

Pages 594 - 601

https://doi.org/10.1145/3442442.3452347

Published: 03 June 2021 Publication History

Abstract

A major challenge for many analyses of Wikipedia dynamics—e.g., imbalances in content quality, geographic differences in what content is popular, what types of articles attract more editor discussion—is grouping the very diverse range of Wikipedia articles into coherent, consistent topics. This problem has been addressed using various approaches based on Wikipedia’s category network, WikiProjects, and external taxonomies. However, these approaches have always been limited in their coverage: typically, only a small subset of articles can be classified, or the method cannot be applied across (the more than 300) languages on Wikipedia. In this paper, we propose a language-agnostic approach based on the links in an article for classifying articles into a taxonomy of topics that can be easily applied to (almost) any language and article on Wikipedia. We show that it matches the performance of a language-dependent approach while being simpler and having much greater coverage.

References

[1]

Ahmad Aghaebrahimian, Andy Stauder, and Michael Ustaszewski. 2020. Testing the validity of Wikipedia categories for subject matter labelling of open-domain corpus data. Journal of Information Science and Engineering (Dec. 2020), 0165551520977438. https://doi.org/10.1177/0165551520977438

[2]

Sumit Asthana and Aaron Halfaker. 2018. With few eyes, all hoaxes are deep. Proceedings of the ACM on Human-Computer Interaction 2, CSCW(2018), 1–18.

Digital Library

[3]

EM Bender, T Gebru, A McMillan-Major, 2021. On the dangers of stochastic parrots: Can language models be too big. Proceedings of FAccT(2021).

Digital Library

[4]

Freddy Brasileiro, João Paulo A Almeida, Victorio A Carvalho, and Giancarlo Guizzardi. 2016. Applying a multi-level modeling theory to assess taxonomic hierarchies in Wikidata. In Proceedings of the 25th International Conference Companion on World Wide Web. 975–980.

Digital Library

[5]

Elizabeth Clark, Anne Spencer Ross, Chenhao Tan, Yangfeng Ji, and Noah A Smith. 2018. Creative writing with a machine in the loop: Case studies on slogans and stories. In 23rd International Conference on Intelligent User Interfaces. 329–340.

Digital Library

[6]

Maurizio Ferrari Dacrema, Paolo Cremonesi, and Dietmar Jannach. 2019. Are we really making much progress? A worrying analysis of recent neural recommendation approaches. In Proceedings of the 13th ACM Conference on Recommender Systems. 101–109.

Digital Library

[7]

Alexander D’Amour, Katherine Heller, Dan Moldovan, Ben Adlam, Babak Alipanahi, Alex Beutel, Christina Chen, Jonathan Deaton, Jacob Eisenstein, Matthew D Hoffman, 2020. Underspecification presents challenges for credibility in modern machine learning. arXiv preprint arXiv:2011.03395(2020).

[8]

R Stuart Geiger. 2014. Bots, bespoke, code and the materiality of software platforms. Information, Communication & Society 17, 3 (2014), 342–356.

[9]

Aaron Halfaker and R Stuart Geiger. 2020. Ores: Lowering barriers with participatory machine learning in wikipedia. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2(2020), 1–37.

Digital Library

[10]

Andrew Hall, Sarah McRoberts, Jacob Thebault-Spieker, Yilun Lin, Shilad Sen, Brent Hecht, and Loren Terveen. 2017. Freedom versus standardization: structured data generation in a peer production community. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 6352–6362.

Digital Library

[11]

Brent Hecht and Darren Gergle. 2010. The tower of Babel meets web 2.0: user-generated content and its applications in a multilingual context. In Proceedings of the SIGCHI conference on human factors in computing systems. 291–300.

Digital Library

[12]

James M Heilman, Eckhard Kemmann, Michael Bonert, Anwesh Chatterjee, Brent Ragar, Graham M Beards, David J Iberri, Matthew Harvey, Brendan Thomas, Wouter Stomp, 2011. Wikipedia: a key tool for global public health promotion. Journal of medical Internet research 13, 1 (2011), e14.

[13]

Isaac Johnson, Florian Lemmerich, Diego Sáez-Trumper, Robert West, Markus Strohmaier, and Leila Zia. 2020. Global gender differences in Wikipedia readership. arXiv preprint arXiv:2007.10403(2020).

[14]

Armand Joulin, Édouard Grave, Piotr Bojanowski, and Tomáš Mikolov. 2017. Bag of Tricks for Efficient Text Classification. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers. 427–431.

[15]

Jens Lehmann, Robert Isele, Max Jakob, Anja Jentzsch, Dimitris Kontokostas, Pablo N Mendes, Sebastian Hellmann, Mohamed Morsey, Patrick Van Kleef, Sören Auer, 2015. Dbpedia–a large-scale, multilingual knowledge base extracted from wikipedia. Semantic web 6, 2 (2015), 167–195.

[16]

Włodzimierz Lewoniewski, Krzysztof Węcel, and Witold Abramowicz. 2017. Relative quality and popularity evaluation of multilingual Wikipedia articles. In Informatics, Vol. 4. Multidisciplinary Digital Publishing Institute, 43.

[17]

Włodzimierz Lewoniewski, Krzysztof Węcel, and Witold Abramowicz. 2019. Multilingual ranking of Wikipedia articles with quality and popularity assessment in different topics. Computers 8, 3 (2019), 60.

[18]

David Mimno, Hanna M Wallach, Jason Naradowsky, David A Smith, and Andrew McCallum. 2009. Polylingual Topic Models. In Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, Singapore, 880–889.

[19]

Blagoj Mitrevski, Tiziano Piccardi, and Robert West. 2020. WikiHist. html: English Wikipedia’s Full Revision History in HTML Format. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 14. 878–884.

[20]

Volodymyr Miz, Joëlle Hanna, Nicolas Aspert, Benjamin Ricaud, and Pierre Vandergheynst. 2020. What is trending on Wikipedia? capturing trends and language biases across Wikipedia editions. In Companion Proceedings of the Web Conference 2020. 794–801.

Digital Library

[21]

Oleksii Moskalenko, Denis Parra, and Diego Saez-Trumper. 2020. Scalable recommendation of wikipedia articles to editors using representation learning. ComplexRec 2020, Workshop on Recommendation in Complex Scenarios at the ACM RecSys Conference on Recommender Systems (RecSys 2020) (2020).

[22]

Tiziano Piccardi, Michele Catasta, Leila Zia, and Robert West. 2018. Structuring Wikipedia articles with section recommendations. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 665–674.

Digital Library

[23]

Tiziano Piccardi and Robert West. 2020. Crosslingual Topic Modeling with WikiPDA. arXiv preprint arXiv:2009.11207(2020).

[24]

Alessandro Piscopo and Elena Simperl. 2018. Who models the world? Collaborative ontology creation and user roles in Wikidata. Proceedings of the ACM on Human-Computer Interaction 2, CSCW(2018), 1–18.

[25]

Steffen Rendle, Walid Krichene, Li Zhang, and John Anderson. 2020. Neural collaborative filtering vs. matrix factorization revisited. In Fourteenth ACM Conference on Recommender Systems. 240–248.

Digital Library

[26]

Shilad Sen, Anja Beth Swoap, Qisheng Li, Brooke Boatman, Ilse Dippenaar, Rebecca Gold, Monica Ngo, Sarah Pujol, Bret Jackson, and Brent Hecht. 2017. Cartograph: Unlocking spatial visualization through semantic enhancement. In Proceedings of the 22nd international conference on intelligent user interfaces. 179–190.

Digital Library

[27]

Philipp Singer, Florian Lemmerich, Robert West, Leila Zia, Ellery Wulczyn, Markus Strohmaier, and Jure Leskovec. 2017. Why we read Wikipedia. In Proceedings of the 26th international conference on world wide web. 1591–1600.

Digital Library

[28]

C Estelle Smith, Bowen Yu, Anjali Srivastava, Aaron Halfaker, Loren Terveen, and Haiyi Zhu. 2020. Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[29]

Morten Warncke-Wang, Dan Cosley, and John Riedl. 2013. Tell me more: an actionable quality model for Wikipedia. In Proceedings of the 9th International Symposium on Open Collaboration. 1–10.

Digital Library

[30]

Morten Warncke-Wang, Vivek Ranjan, Loren Terveen, and Brent Hecht. 2015. Misalignment between supply and demand of quality content in peer production communities. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 9.

[31]

Diyi Yang, Aaron Halfaker, Robert Kraut, and Eduard Hovy. 2017. Identifying semantic edit intentions from revisions in wikipedia. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. 2000–2010.

Cited By

Alet MSaez-Trumper D(2024)Constructing a Common Ground: Analyzing the quality and usage of International Auxiliary Languages in WikipediaProceedings of the 35th ACM Conference on Hypertext and Social Media10.1145/3648188.3675126(142-147)Online publication date: 10-Sep-2024
https://dl.acm.org/doi/10.1145/3648188.3675126
Halitaj AZubiaga A(2024)Providing Citations to Support Fact-Checking: Contextualizing Detection of Sentences Needing Citation on Small WikipediasNatural Language Processing Journal10.1016/j.nlp.2024.1000938(100093)Online publication date: Sep-2024
https://doi.org/10.1016/j.nlp.2024.100093
Ruprechter TBurghardt KHelic D(2023)Poor attention: The wealth and regional gaps in event attention and coverage on WikipediaPLOS ONE10.1371/journal.pone.028932518:11(e0289325)Online publication date: 8-Nov-2023
https://doi.org/10.1371/journal.pone.0289325
Show More Cited By

Recommendations

Topic Modeling for Wikipedia Link Disambiguation

Many articles in the online encyclopedia Wikipedia have hyperlinks to ambiguous article titles; these ambiguous links should be replaced with links to unambiguous articles, a process known as disambiguation. We propose a novel statistical topic model ...
Cross-media topic mining on wikipedia
MM '13: Proceedings of the 21st ACM international conference on Multimedia

As a collaborative wiki-based encyclopedia, Wikipedia provides a huge amount of articles of various categories. In addition to their text corpus, Wikipedia also contains plenty of images which makes the articles more intuitive for readers to understand. ...
Learning multilingual named entity recognition from Wikipedia

We automatically create enormous, free and multilingual silver-standard training annotations for named entity recognition (ner) by exploiting the text and structure of Wikipedia. Most ner systems rely on statistical models of annotated data to identify ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WWW '21: Companion Proceedings of the Web Conference 2021

April 2021

726 pages

ISBN:9781450383134

DOI:10.1145/3442442

Editors:
Jure Leskovec
Stanford
,
Marko Grobelnik
Jožef Stefan Institute
,
Marc Najork
Google
,
Jie Tang
Tsinghua University
,
Leila Zia
Wikimedia Foundation

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 June 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

WWW '21

Sponsor:

SIGWEB

WWW '21: The Web Conference 2021

April 19 - 23, 2021

Ljubljana, Slovenia

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
140
Total Downloads

Downloads (Last 12 months)25
Downloads (Last 6 weeks)2

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Alet MSaez-Trumper D(2024)Constructing a Common Ground: Analyzing the quality and usage of International Auxiliary Languages in WikipediaProceedings of the 35th ACM Conference on Hypertext and Social Media10.1145/3648188.3675126(142-147)Online publication date: 10-Sep-2024
https://dl.acm.org/doi/10.1145/3648188.3675126
Halitaj AZubiaga A(2024)Providing Citations to Support Fact-Checking: Contextualizing Detection of Sentences Needing Citation on Small WikipediasNatural Language Processing Journal10.1016/j.nlp.2024.1000938(100093)Online publication date: Sep-2024
https://doi.org/10.1016/j.nlp.2024.100093
Ruprechter TBurghardt KHelic D(2023)Poor attention: The wealth and regional gaps in event attention and coverage on WikipediaPLOS ONE10.1371/journal.pone.028932518:11(e0289325)Online publication date: 8-Nov-2023
https://doi.org/10.1371/journal.pone.0289325
Găman MIonescu R(2022)The unreasonable effectiveness of machine learning in Moldavian versus Romanian dialect identificationInternational Journal of Intelligent Systems10.1002/int.2274637:8(4928-4966)Online publication date: 28-Jun-2022
https://dl.acm.org/doi/10.1002/int.22746
Huang XWang CSun QLi YLi W(2021)Temporal Analysis of Knowledge Networks2021 IEEE International Conference on Big Knowledge (ICBK)10.1109/ICKG52313.2021.00034(190-197)Online publication date: Dec-2021
https://doi.org/10.1109/ICKG52313.2021.00034

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents