research-article

Amplifying community content creation with mixed initiative information extraction

Authors:

Raphael Hoffmann,

Saleema Amershi,

Daniel S. WeldAuthors Info & Claims

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1849 - 1858

https://doi.org/10.1145/1518701.1518986

Published: 04 April 2009 Publication History

Abstract

Although existing work has explored both information extraction and community content creation, most research has focused on them in isolation. In contrast, we see the greatest leverage in the synergistic pairing of these methods as two interlocking feedback cycles. This paper explores the potential synergy promised if these cycles can be made to accelerate each other by exploiting the same edits to advance both community content creation and learning-based information extraction. We examine our proposed synergy in the context of Wikipedia infoboxes and the Kylin information extraction system. After developing and refining a set of interfaces to present the verification of Kylin extractions as a non primary task in the context of Wikipedia articles, we develop an innovative use of Web search advertising services to study people engaged in some other primary task. We demonstrate our proposed synergy by analyzing our deployment from two complementary perspectives: (1) we show we accelerate community content creation by using Kylin's information extraction to significantly increase the likelihood that a person visiting a Wikipedia article as a part of some other primary task will spontaneously choose to help improve the article's infobox, and (2) we show we accelerate information extraction by using contributions collected from people interacting with our designs to significantly improve Kylin's extraction performance.

References

[1]

Bryant, S.L., Forte, A. and Bruckman, A. (2005). Becoming Wikipedian: Transformation of Participation in a Collaborative Online Encyclopedia. Proceedings of the ACM Conference on Supporting Group Work (GROUP 2005), 1--10.

Digital Library

[2]

Cosley, D., Frankowski, D., Terveen, L. and Riedl, J. (2007). SuggestBot: Using Intelligent Task Routing to Help People Find Work in Wikipedia. Proceedings of the International Conference on Intelligent User Interfaces (IUI 2007), 32--41.

Digital Library

[3]

Culotta, A., Kristjansson, T., McCallum, A. and Viola, P. (2006). Corrective Feedback and Persistent Learning for Information Extraction. Artificial Intelligence 170(14). 1101--1122.

Digital Library

[4]

DeRose, P., Chai, X., Gao, B., Shen, W., Doan, A., Bohannon, P. and Zhu, J. (2008). Building Community Wikipedias: A Human-Machine Approach. Proceedings of the IEEE International Conference on Data Engineering (ICDE 2008), 646--655.

Digital Library

[5]

Giles, C.L., Bollacker, K. and Lawrence, S. (1998). CiteSeer: An Automatic Citation Indexing System. Proceedings of the ACM Conference on Digital Libraries (DL 1998), 89--98.

Digital Library

[6]

Grudin, J. (1994). Groupware and Social Dynamics: Eight Challenges for Developers. Communications of the ACM 37(1). 92--105.

Digital Library

[7]

Hoffmann, R., Fogarty, J. and Weld, D.S. (2007). Assieme: Finding and Leveraging Implicit References in a Web Search Interface for Programmers. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2007), 13--22.

Digital Library

[8]

Horvitz, E. (1999). Principles of Mixed-Initiative Interfaces. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 1999), 159--166.

Digital Library

[9]

Huynh, D.F., Miller, R.C. and Karger, D.R. (2006). Enabling Web Browsers to Augment Web Sites' Filtering and Sorting Functionalities. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2006), 125--134.

Digital Library

[10]

Kuznetsov, S. (2006). Motivations of Contributors to Wikipedia. ACM Computers and Society 36(2). 1--7.

Digital Library

[11]

Mankoff, J., Hudson, S.E. and Abowd, G.D. (2000). Interaction Techniques for Ambiguity Resolution in Recognition-Based Interfaces. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2000), 11--20.

Digital Library

[12]

McCann, R., Shen, W. and Doan, A. (2008). Matching Schemas in Online Communities: A Web 2.0 Approach. Proceedings of the IEEE International Conference on Data Engineering (ICDE 2008), 110--119.

Digital Library

[13]

McFarlane, D.C. (2002). Comparison of Four Primary Methods for Coordinating the Interruption of People in Human-Computer Interaction. Human-Computer Interaction 17(1). 63--139.

Digital Library

[14]

MediaWiki. http://www.mediawiki.org/.

[15]

Priedhorsky, R., Chen, J., Lam, S.T., Panciera, K., Terveen, L. and Riedl, J. (2007). Creating, Destroying, and Restoring Value in Wikipedia. Proceedings of the ACM Conference on Supporting Group Work (GROUP 2007), 259--268.

Digital Library

[16]

Shilman, M., Tan, D.S. and Simard, P. (2006). CueTIP: A Mixed-Initiative Interface for Correcting Handwriting Errors. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2006), 323--332.

Digital Library

[17]

von Ahn, L. and Dabbish, L. (2004). Labeling Images with a Computer Game. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2004), 319--326.

Digital Library

[18]

von Ahn, L. and Dabbish, L. (2008). Designing Games with a Purpose. Communications of the ACM 51(8). 58--67.

Digital Library

[19]

Voss, J. (2005). Measuring Wikipedia. International Conference of the International Society for Scientometrics and Informetrics (ISSI 2005), 221--231.

[20]

Wikipedia: AutoWikiBrowser. http://en.wikipedia.org/wiki/Wikipedia:AutoWikiBrowser.

[21]

Wikipedia: Be Bold. http://en.wikipedia.org/wiki/Wikipedia:Be_Bold.

[22]

Wikipedia: Bot Policy. http://en.wikipedia.org/wiki/Wikipedia:Bots.

[23]

Wikipedia: Cleanup Tags. http://en.wikipedia.org/wiki/Wikipedia:Template_messages/Cleanup.

[24]

Wu, F., Hoffman, R. and Weld, D.S. (2008). Information Extraction from Wikipedia: Moving Down the Long Tail. Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining (KDD 2008), 731--739.

Digital Library

[25]

Wu, F. and Weld, D.S. (2007). Autonomously Semantifying Wikipedia. Proceedings of the ACM Conference on Information and Knowledge Management (CIKM 2007), 41--50.

Digital Library

[26]

Yee, K.-P., Swearingen, K., Li, K. and Hearst, M. (2003). Faceted Metadata for Image Search and Browsing. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI 2003), 401--408.

Digital Library

Cited By

Lo Cde Longueau ESaha AChatterjee S(2020)Edge formation in Social Networks to Nurture Content CreatorsProceedings of The Web Conference 202010.1145/3366423.3380267(1999-2008)Online publication date: 20-Apr-2020
https://dl.acm.org/doi/10.1145/3366423.3380267
Cai JKowalczyk MWilliams T(2019)Gadgets and Anti-Gadgets Leading to a Complexity DichotomyACM Transactions on Computation Theory10.1145/330527211:2(1-26)Online publication date: 17-Feb-2019
https://dl.acm.org/doi/10.1145/3305272
Tu YLo CYuan YChatterjee STeredesai AKumar VLi YRosales RTerzi EKarypis G(2019)Feedback ShapingProceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining10.1145/3292500.3330764(2241-2250)Online publication date: 25-Jul-2019
https://dl.acm.org/doi/10.1145/3292500.3330764
Show More Cited By

Index Terms

Amplifying community content creation with mixed initiative information extraction
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Automatic gazette creation for named entity recognition and application to resume processing
COMPUTE '12: Proceedings of the 5th ACM COMPUTE Conference: Intelligent & scalable system technologies

Named entities are important content-carrying units within documents. Consequently named entity recognition (NER) is an important part of information extraction. One fast and accurate approach to NER uses a list or gazette consisting of known instances. ...
A Flexible Text Mining System for Entity and Relation Extraction in PubMed
DTMBIO '15: Proceedings of the ACM Ninth International Workshop on Data and Text Mining in Biomedical Informatics

Due to an enormous number of scientific publications that cannot be handled manually, there is a rising interest in text-mining techniques for automated information extraction, especially in the biomedical field. Such techniques provide effective means ...
Two learning approaches for protein name extraction

Protein name extraction, one of the basic tasks in automatic extraction of information from biological texts, remains challenging. In this paper, we explore the use of two different machine learning techniques and present the results of the conducted ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2009

2426 pages

ISBN:9781605582467

DOI:10.1145/1518701

General Chairs:
Dan R. Olsen
Brigham Young University
,
Richard B. Arthur
Brigham Young University
,
Program Chairs:
Ken Hinckley
Microsoft Research
,
Meredith Ringel Morris
Microsoft Research
,
Scott Hudson
Carnegie Mellon University
,
Saul Greenberg
University of Calgary

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 April 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '09

Sponsor:

CHI '09: CHI Conference on Human Factors in Computing Systems

April 4 - 9, 2009

MA, Boston, USA

Acceptance Rates

CHI '09 Paper Acceptance Rate 277 of 1,130 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

46
Total Citations
View Citations
776
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)2

Reflects downloads up to 06 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lo Cde Longueau ESaha AChatterjee S(2020)Edge formation in Social Networks to Nurture Content CreatorsProceedings of The Web Conference 202010.1145/3366423.3380267(1999-2008)Online publication date: 20-Apr-2020
https://dl.acm.org/doi/10.1145/3366423.3380267
Cai JKowalczyk MWilliams T(2019)Gadgets and Anti-Gadgets Leading to a Complexity DichotomyACM Transactions on Computation Theory10.1145/330527211:2(1-26)Online publication date: 17-Feb-2019
https://dl.acm.org/doi/10.1145/3305272
Tu YLo CYuan YChatterjee STeredesai AKumar VLi YRosales RTerzi EKarypis G(2019)Feedback ShapingProceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining10.1145/3292500.3330764(2241-2250)Online publication date: 25-Jul-2019
https://dl.acm.org/doi/10.1145/3292500.3330764
Zhai CLafferty J(2017)A Study of Smoothing Methods for Language Models Applied to Ad Hoc Information RetrievalACM SIGIR Forum10.1145/3130348.313037751:2(268-276)Online publication date: 2-Aug-2017
https://dl.acm.org/doi/10.1145/3130348.3130377
Lavrenko VCroft W(2017)Relevance-Based Language ModelsACM SIGIR Forum10.1145/3130348.313037651:2(260-267)Online publication date: 2-Aug-2017
https://dl.acm.org/doi/10.1145/3130348.3130376
Fagan J(2017)Automatic P h r a s e Indexing for Document RetrievalACM SIGIR Forum10.1145/3130348.313035551:2(51-61)Online publication date: 2-Aug-2017
https://dl.acm.org/doi/10.1145/3130348.3130355
Lindley SWallace J(2015)Placing in AgeACM Transactions on Computer-Human Interaction10.1145/275556222:4(1-39)Online publication date: 29-Jun-2015
https://dl.acm.org/doi/10.1145/2755562
Gil YMichel FRatnakar VHauder MDuffy CDugan HHanson P(2015)A Task-Centered Framework for Computationally-Grounded Science CollaborationsProceedings of the 2015 IEEE 11th International Conference on e-Science10.1109/eScience.2015.76(352-361)Online publication date: 31-Aug-2015
https://dl.acm.org/doi/10.1109/eScience.2015.76
Amershi SCakmak MKnox WKulesza T(2014)Power to the PeopleAI Magazine10.1609/aimag.v35i4.251335:4(105-120)Online publication date: 1-Dec-2014
https://dl.acm.org/doi/10.1609/aimag.v35i4.2513
Ipeirotis PGabrilovich EChung CBroder AShim KSuel T(2014)QuizzProceedings of the 23rd international conference on World wide web10.1145/2566486.2567988(143-154)Online publication date: 7-Apr-2014
https://dl.acm.org/doi/10.1145/2566486.2567988
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents