Article

A method of rating the credibility of news documents on the web

Authors:

Ryosuke Nagura,

Yohei Seki,

Noriko Kando,

Masaki AonoAuthors Info & Claims

SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval

Pages 683 - 684

https://doi.org/10.1145/1148170.1148316

Published: 06 August 2006 Publication History

Get Access

Abstract

We propose a method to rate the credibility of news articles using three clues: (1) commonality of the contents of articles among different news publishers; (2) numerical agreement versus contradiction of numerical values reported in the articles; and (3) objectivity based on subjective speculative phrases and news sources. We tested this method on news stories taken from seven different news sites on the Web. The average agreement between the system-produced "credibility" and the manual judgments of three human assessors on the 52 sample articles was 69.1%. The limitations of the current approach and future directions are discussed.

References

[1]

Abdulla, R. A., Garrison, B., Salwen, M., Driscoll, P., and Casey, D. The Credibility of Newspapers, Television News, and Online News. In Proc. of the Association for Education in Journalism and Mass Communication Annual Convention, Miami Beach, FL, 2002.

Google Scholar

[2]

Danielson, D. R. Web Credibility. In Encyclopedia of Human Computer Interaction, pages 713--721. Idea Group Reference, 2005.

Google Scholar

[3]

Ord, R. Google News Patent Application - Full Text {online}, 2005 {cited 2005-12-26}. Available from: <http://www.webpronews.com/news/ebusinessnews/wpn-45-20050503GoogleNewsPatentApplicationFullText.html>.

Google Scholar

[4]

Rubin, V. L., Liddy, E. D., and Kando, N. Certainty Identification in Texts: Categorization Model and Manual Tagging Results. In Computing Attitude and Affect in Text: Theories and Applications, pages 61--74. Springer, Dordrecht, The Netherlands, 2005.

Google Scholar

Cited By

View all

Aghajari ZBaumer EDiFranzo D(2023)Reviewing Interventions to Address Misinformation: The Need to Expand Our Vision Beyond an Individualistic FocusProceedings of the ACM on Human-Computer Interaction10.1145/35795207:CSCW1(1-34)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579520
Rubin VRubin V(2022)Credibility Assessment Models and Trust Indicators in Social SciencesMisinformation and Disinformation10.1007/978-3-030-95656-1_3(61-94)Online publication date: 15-Jun-2022
https://doi.org/10.1007/978-3-030-95656-1_3
Tsang S(2021)News Credibility and Media Literacy in the Digital AgeResearch Anthology on Fake News, Political Warfare, and Combatting the Spread of Misinformation10.4018/978-1-7998-7291-7.ch031(544-564)Online publication date: 2021
https://doi.org/10.4018/978-1-7998-7291-7.ch031
Show More Cited By

Index Terms

A method of rating the credibility of news documents on the web
1. Information systems
  1. Information retrieval
    1. Retrieval models and ranking
    2. Retrieval tasks and goals
      1. Document filtering
      2. Information extraction

Recommendations

An examination of the effect of involvement level of web site users on the perceived credibility of web sites
Aesthetics and credibility in web site design

Web sites often provide the first impression of an organization. For many organizations, web sites are crucial to ensure sales or to procure services within. When a person opens a web site, the first impression is probably made in a few seconds, and the ...
Understanding Web Credibility: A Synthesis of the Research Literature

Comments

Information & Contributors

Information

Published In

SIGIR '06: Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval

August 2006

768 pages

ISBN:1595933697

DOI:10.1145/1148170

General Chair:
Efthimis N. Efthimiadis
University of Washington
,
Program Chairs:
Susan Dumais
Microsoft Research, Redmond
,
David Hawking
CSIRO ICT Centre, Canberra, Australia
,
Kalervo Järvelin,
University of Tampere, Finland

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 August 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGIR06

Sponsor:

SIGIR06: The 29th Annual International SIGIR Conference

August 6 - 11, 2006

Washington, Seattle, USA

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
941
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Aghajari ZBaumer EDiFranzo D(2023)Reviewing Interventions to Address Misinformation: The Need to Expand Our Vision Beyond an Individualistic FocusProceedings of the ACM on Human-Computer Interaction10.1145/35795207:CSCW1(1-34)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579520
Rubin VRubin V(2022)Credibility Assessment Models and Trust Indicators in Social SciencesMisinformation and Disinformation10.1007/978-3-030-95656-1_3(61-94)Online publication date: 15-Jun-2022
https://doi.org/10.1007/978-3-030-95656-1_3
Tsang S(2021)News Credibility and Media Literacy in the Digital AgeResearch Anthology on Fake News, Political Warfare, and Combatting the Spread of Misinformation10.4018/978-1-7998-7291-7.ch031(544-564)Online publication date: 2021
https://doi.org/10.4018/978-1-7998-7291-7.ch031
Yu ZWang MWei XLou J(2021)News Credibility and Influence within the Financial MarketsJournal of Behavioral Finance10.1080/15427560.2021.197444324:2(238-257)Online publication date: 9-Sep-2021
https://doi.org/10.1080/15427560.2021.1974443
Tsang S(2019)News Credibility and Media Literacy in the Digital AgeHandbook of Research on Media Literacy Research and Applications Across Disciplines10.4018/978-1-5225-9261-7.ch009(135-155)Online publication date: 2019
https://doi.org/10.4018/978-1-5225-9261-7.ch009
Zhang ARanganathan AMetz SAppling SSehat CGilmore NAdams NVincent ELee JRobbins MBice EHawke SKarger DMina AChampin PGandon FMédini LLalmas MIpeirotis P(2018)A Structured Response to MisinformationCompanion Proceedings of the The Web Conference 201810.1145/3184558.3188731(603-612)Online publication date: 23-Apr-2018
https://dl.acm.org/doi/10.1145/3184558.3188731
Wang TZhu QWang S(2013)MFSV: A Truthfulness Determination Approach for Fact StatementsDatabase Systems for Advanced Applications10.1007/978-3-642-37450-0_11(155-163)Online publication date: 2013
https://doi.org/10.1007/978-3-642-37450-0_11
Wang TZhu QWang SLiang J(2012)FindCredPgProceedings of the 14th Asia-Pacific international conference on Web Technologies and Applications10.1007/978-3-642-29253-8_24(282-293)Online publication date: 11-Apr-2012
https://dl.acm.org/doi/10.1007/978-3-642-29253-8_24
Al‐Khalifa HAl‐Eidan R(2011)An experimental system for measuring the credibility of news content in TwitterInternational Journal of Web Information Systems10.1108/174400811111417727:2(130-151)Online publication date: 21-Jun-2011
https://doi.org/10.1108/17440081111141772
Al-Eidan RAl-Khalifa HAl-Salman A(2010)Measuring the credibility of Arabic text content in Twitter2010 Fifth International Conference on Digital Information Management (ICDIM)10.1109/ICDIM.2010.5664223(285-291)Online publication date: Jul-2010
https://doi.org/10.1109/ICDIM.2010.5664223
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

An examination of the effect of involvement level of web site users on the perceived credibility of web sites

Aesthetics and credibility in web site design

Understanding Web Credibility: A Synthesis of the Research Literature

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations