research-article

Incident threading for news passages

Authors:

James AllanAuthors Info & Claims

CIKM '09: Proceedings of the 18th ACM conference on Information and knowledge management

Pages 1307 - 1316

https://doi.org/10.1145/1645953.1646118

Published: 02 November 2009 Publication History

Abstract

With an overwhelming volume of news reports currently available, there is an increasing need for automatic techniques to analyze and present news to a general reader in a meaningful and efficient manner. We explore incident threading as a possible solution to this problem. All text that describes the occurrence of a real-world happening is merged into a news incident, and incidents are organized in a network with dependencies of predefined types.

Earlier attempts at this problem have assumed that a news story covers a single topic. We move beyond that limitation to introduce passage threading, which processes news at the passage level. First we develop a new testbed for this research and extend the evaluation methods to address new granularity issues. Then a three-stage algorithm is described that identifies on-subject passages, groups them into incidents, and establishes links between related incidents. Finally, we observe significant improvement over earlier work when we optimize the harmonic mean of the appropriate evaluation measures. The resulting performance exceeds the level that a calibration study shows is necessary to support a reading comprehension task.

References

[1]

Allan, J. Topic Detection and Tracking: event-based information organization. Kluwer Academic Publishers, 2002.

Digital Library

[2]

Allan, J. Introduction to Topic Detection and Tracking. In Topic Detection and Tracking: event-based information organization, Kluwer Academic Publishers, pp. 1--16, 2002.

[3]

Allan, J., Carbonell, J., Doddington, G., Yamron, J., and Yang, Y. Topic Detection and Tracking Pilot Study: Final Report. Proceedings of the DARPA Broadcast News Transcription and Understanding Workshop, pp 194--218, 1998.

[4]

Beeferman, D., Berger, A., and Lafferty, J. Text Segmentation using Exponential Models. Proceedings of the Second Conference on Empirical Methods in Natural Language Processing, pp. 35--46, 1997.

[5]

Brown, G. and Yule, G. Discourse Analysis. Cambridge University Press. 1983.

[6]

Callan, J., Croft, W. B., and Harding, S. The INQUERY Retrieval System. Proceedings of the 3rd International Conference on Database and Expert Systems Application, pp. 78--83, 1992.

[7]

Cohen, J. A coefficient of agreement for nominal scales. Educational and Psychological Measurement, vol. 20, pp. 37--46, 1960.

[8]

Feng, A. and Allan, J. Finding and Linking Incidents in News. Proceedings of the ACM Sixteenth Conference on Information and Knowledge Management, pp. 821--829, 2007.

Digital Library

[9]

Fiscus, J. and Wheatley, B. Overview of the TDT 2004 Evaluation and Results. Topic Detection and Tracking 2004 Evaluation Workshop, NIST, Dec 2--3, 2004.

[10]

Fleiss, J. L. Measuring nominal scale agreement among many raters. Psychological Bulletin, vol. 76(5), pp. 378--382, 1971.

[11]

Grishman, R. and Sundheim, B. Message Understanding Conference -- 6: A Brief History. Proceedings of the 16th International Conference on Computational Linguistics (COLING), pp. 466--471, 1996.

Digital Library

[12]

Hearst, M. A. TextTiling: A Quantitative Approach to Discourse Segmentation. Proceedings of the 32nd annual meeting on Association for Computational Linguistics, pp. 9--16, 1994.

Digital Library

[13]

Jaynes, E. T. Information Theory and Statistical Mechanics. Physics Reviews, vol. 106, pp. 620--630, 1957.

[14]

Nallapati, R., Feng, A., Peng, F., and Allan, J. Event Threading within News Topics. Proceedings of CIKM 2004 conference, pp. 446--453, 2004.

Digital Library

[15]

O'Leary, D. E. The Internet, intranets, and the AI renaissance. Computer, Vol. 30(1), pp. 71--78, 1997.

Digital Library

[16]

Olive, J. Global Autonomous Language Exploitation (GALE). DARPA/IPTO Proposal Information Pamphlet, 2005.

[17]

Robertson, S. E., Walker, S., Honcock--Beaulieu, M., Gull, A., and Lau, M. Okapi in TREC-7: Automatic ad hoc, filtering, VLC and interactive track. The Seventh Text REtrieval Conference (TREC-7), NIST, 1998.

[18]

Schank, R. C. and Abelson, R. P. Scripts, Plans, Goals, and Understanding: an Inquiry into Human Knowledge Structure. Lawrence Erlbaum Associates, 1977.

[19]

Schapire, R. E. and Singer, Y. BoosTexter: A Boosting-based System for Text Categorization. Machine Learning, vol. 39(2/3), pp. 135--168, 2000.

Digital Library

[20]

van Dijk, T. A. Discourse Analysis: Its Development and Application to the Structure of News. The Journal of Communication, 33(2), pp. 20--43, 1983.

[21]

van Dijk, T. A. News as Discourse. Lawrence Erlbaum Associates, 1988.

[22]

Vapnik, V. N. The Nature of Statistical Learning Theory. Springer, 1995.

Digital Library

Cited By

Shi KWang XYu JHou LLi JWu JYong DXiao JLiu QAl Hasan MXiong L(2022)CStory: A Chinese Large-scale News Storyline DatasetProceedings of the 31st ACM International Conference on Information & Knowledge Management10.1145/3511808.3557573(4475-4479)Online publication date: 17-Oct-2022
https://dl.acm.org/doi/10.1145/3511808.3557573
Li QMa YYang Z(2017)Event Cube – A Conceptual Framework for Event Modeling and AnalysisWeb Information Systems Engineering – WISE 201710.1007/978-3-319-68783-4_34(499-515)Online publication date: 4-Oct-2017
https://doi.org/10.1007/978-3-319-68783-4_34
Zhao MOhshima HTanaka K(2016)Finding “Similar but Different” Documents Based on Coordinate RelationshipDigital Libraries: Knowledge, Information, and Data in an Open Access Society10.1007/978-3-319-49304-6_15(110-123)Online publication date: 15-Nov-2016
https://doi.org/10.1007/978-3-319-49304-6_15
Show More Cited By

Index Terms

Incident threading for news passages
1. Information systems

Recommendations

Finding and linking incidents in news
CIKM '07: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management

News reports are being produced and disseminated in overwhelming volume, making it difficult to keep up with the newest information. Most previous research in automatic news organization treated news topics as a flat list, ignoring the intrinsic ...
Incident threading in news
A Keyphrase-Based Approach to Text Summarization for English and Bengali Documents

With the rapid growth of the World Wide Web, information overload is becoming a problem for an increasingly large number of people. Since summarization helps human to digest the main contents of a text document very rapidly, there is a need for an ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '09: Proceedings of the 18th ACM conference on Information and knowledge management

November 2009

2162 pages

ISBN:9781605585123

DOI:10.1145/1645953

General Chairs:
David Cheung
University of Hong Kong, Hong Kong
,
Il-Yeol Song
Drexel University, USA
,
Program Chairs:
Wesley Chu
UCLA, USA
,
Xiaohua Hu
Drexel University, USA
,
Jimmy Lin
University of Maryland, USA

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CIKM '09

Sponsor:

CIKM '09: Conference on Information and Knowledge Management

November 2 - 6, 2009

Hong Kong, China

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
342
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Shi KWang XYu JHou LLi JWu JYong DXiao JLiu QAl Hasan MXiong L(2022)CStory: A Chinese Large-scale News Storyline DatasetProceedings of the 31st ACM International Conference on Information & Knowledge Management10.1145/3511808.3557573(4475-4479)Online publication date: 17-Oct-2022
https://dl.acm.org/doi/10.1145/3511808.3557573
Li QMa YYang Z(2017)Event Cube – A Conceptual Framework for Event Modeling and AnalysisWeb Information Systems Engineering – WISE 201710.1007/978-3-319-68783-4_34(499-515)Online publication date: 4-Oct-2017
https://doi.org/10.1007/978-3-319-68783-4_34
Zhao MOhshima HTanaka K(2016)Finding “Similar but Different” Documents Based on Coordinate RelationshipDigital Libraries: Knowledge, Information, and Data in an Open Access Society10.1007/978-3-319-49304-6_15(110-123)Online publication date: 15-Nov-2016
https://doi.org/10.1007/978-3-319-49304-6_15
Imran MCastillo CDiaz FVieweg S(2015)Processing Social Media Messages in Mass EmergencyACM Computing Surveys10.1145/277158847:4(1-38)Online publication date: 26-Jun-2015
https://dl.acm.org/doi/10.1145/2771588
Bögel TGertz MBogen PAllard SMercer HBeck MCunningham SGoh DHenry G(2015)Time will TellProceedings of the 15th ACM/IEEE-CS Joint Conference on Digital Libraries10.1145/2756406.2756919(195-204)Online publication date: 21-Jun-2015
https://dl.acm.org/doi/10.1145/2756406.2756919
Koutrika GLiu LSimske S(2015)Generating reading orders over document collections2015 IEEE 31st International Conference on Data Engineering10.1109/ICDE.2015.7113310(507-518)Online publication date: Apr-2015
https://doi.org/10.1109/ICDE.2015.7113310
Cai YLi QXie HWang TMin H(2013)Event Relationship Analysis for Temporal Event SearchDatabase Systems for Advanced Applications10.1007/978-3-642-37450-0_13(179-193)Online publication date: 2013
https://doi.org/10.1007/978-3-642-37450-0_13
Nothman JHonnibal MHachey BCurran JLi HLin COsborne M(2012)Event linkingProceedings of the 50th Annual Meeting of the Association for Computational Linguistics: Short Papers - Volume 210.5555/2390665.2390721(228-232)Online publication date: 8-Jul-2012
https://dl.acm.org/doi/10.5555/2390665.2390721
Miranda Ackerman E(2012)Extracting a Causal Network of News TopicsOn the Move to Meaningful Internet Systems: OTM 2012 Workshops10.1007/978-3-642-33618-8_5(33-42)Online publication date: 2012
https://doi.org/10.1007/978-3-642-33618-8_5

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents