skip to main content
10.1145/2108616.2108645acmconferencesArticle/Chapter ViewAbstractPublication PagesicuimcConference Proceedingsconference-collections
research-article

Evaluating credibility of web information

Published: 14 January 2010 Publication History

Abstract

We describe a new concept and method for evaluating the Web information credibility. The quality control of information (text, image, video etc.) on the Web is generally insufficient due to low publishing barriers. As a result, there is a large amount of mistaken and unreliable information on the Web that can have detrimental effects on users. This calls for technology that facilitates the judging of the credibility (expertise and trustworthiness) of Web content and the accuracy of the information that users encounter on the Web. Such technology should be able to handle a wide range of tasks: extracting several credibility-related features from the target Web content, extracting reputation-related information for the target Web content, such as hyperlinks and social bookmarks and evaluating its distribution, and evaluating features of the target content authors. We propose and describe methodologies of analyzing information credibility of Web information: (1) content analysis, (2) social support analysis and (3) author analysis. We overview our recent research activities on Web information credibility evaluation based on this methodologies.

References

[1]
K. Tanaka, T. Matsuyama, E.-P. Lim, A. Jatowt (Eds.): Proceedings of the 2nd ACM Workshop on Information Credibility on the Web, WICOW 2008, Napa Valley, California, USA, October 30, 2008.
[2]
K. Tanaka, X. Zhou, A. Jatowt (Eds.): Proceedings of the 3rd ACM Workshop on Information Credibility on the Web, WICOW 2008, Madrid, Spain, April 20, 2009.
[3]
K. Tanaka: Web search and information credibility analysis: bridging the gap between Web1.0 and Web2.0, Proceedings of the 3rd International Conference on Ubiquitous Information Management and Communication, pp.39--44, January 2009.
[4]
Y. Yamamoto, T. Tezuka, A. Jatowt and K. Tanaka: Supporting Judgement of Fact Trustworthiness Considering Temporal and Sentimental Aspects, Proceedings of the 9th International Conference on Web Information Systems Engineering (WISE2008), Auckland, New Zealand, Springer LNCS, Vol. 5175, pp. 206--220, September 2008.
[5]
M. J. Metzger, A. J. Flanagin, and L. Zwarun: College Student Web Use, Perceptions of Information Credibility, and Verification Behavior: Computers & Education, 41(3): 271--290, November 2003.
[6]
S. Nakamura, S. Konishi, A. Jatowt, H. Ohshima, H. Kondo, T. Tezuka, S. Oyama, and K. Tanaka: Trustworthiness Analysis of Web Search Results, Proc. of the 11th European Conference on Research and Advanced Technology for Digital Libraries (ECDL 2007), LNCS, Vol. 4675, pp. 38--49, Budapest, Hungary, September 2007.
[7]
E. Sillence, P. Briggs, L. Fishwick, and P. Harris: Trust and Mistrust of Online Health Sites. In CHI'04, pages 663--670, 2004.
[8]
P. Denning, J. Horning, D. Parnas, and L. Weinstein. Wikipedia Risks: Communications of the ACM, 48(12): 152--152, 2005.
[9]
N. L. Waters: Why You Can't Cite Wikipedia in My Class, Communications of the ACM, Volume 50, Issue 9, pp. 15--17, September 2007.
[10]
M. Meola: Chucking the Checklist: A Contextual Approach to Teaching Undergraduates Web-site Evaluation, portal: Libraries and the Academy, 4(3): 331--344, July, 2004.
[11]
M. J. Metzger: Making Sense of Credibility on the Web: Models for Evaluating Online Information and Recommendations for Future Research. Journal of the American Society for Information Science and Technology, 58(13): 2078--2091, September 2007.
[12]
B. J. Fogg, J. Marshall, O. Laraki, A. Osipovich, C. Varma, N. Fang, J. Paul, A. Rangnekar, J. Shon, P. Swani, M. Treinen: What makes Web sites credible?: A Report on a Large Quantitative Study, Proceedings of the SIGCHI conference on Human factors in computing systems, CHI2001, pp.61--68, 2001.
[13]
B. J. Fogg and H. Tseng: The Elements of Computer Credibility. In CHI'99, pages 80--87, 1999.
[14]
D. H. McKnight and C. J. Kacmar: Factors and Effects of Information Credibility. In ICEC'07, pages 423--432, 2007.
[15]
B. J. Stiff and A. P. Mongeau: Persuasive Communication, Guilford, Publications, 2002.
[16]
C. N. Wathen and J. Burkell: Believe it or not: Factors Influencing Credibility on the Web, Journal of the American Society for Information Science and Technology, 53(2): 134--144, January 2002.
[17]
B. J. Stiff and A. P. Mongeau: Persuasive Communication, Guilford Publications, 2002.
[18]
J. Cho and S. Roy: Impact of Search Engines on Page Popularity. In WWW'04, pages 20--29, 2004.
[19]
J. Cho, S. Roy, and R. E. Adams: Page Quality: in Search of an Unbiased Web Ranking, In SIGMOD'05, pages 551--562, 2005.
[20]
Zoltan Gyongyi, Hector Garcia-Molina, Jan Pedersen: Combating Web Spam with TrustRank, Proceedings of the 30th VLDB Conference, pp.576--587, Toronto, Canada, 2004.
[21]
M. Nakatani, A. Jatowt, H. Ohshima, K. Tanaka: Quality Evaluation of Search Results by Typicality and Speciality of Terms Extracted from Wikipedia, Proceedings of the 14th International Conference on Database Systems for Advanced Applications, pp.570--584, April 2009.
[22]
Y. Yamamoto, T. Tezuka, A. Jatowt, and K. Tanaka: Honto? Search: Estimating Trustworthiness of Web Information by Search Results Aggregation and Temporal Analysis, Proc. of the Joint Conference of the 9th Asia-Pacific Web Conference and the 8th International Conference on Web-Age Information Management (APWeb/WAIM'07), LNCS Vol. 4505, pp. 253--264, June 2007.
[23]
Y. Yamamoto, T. Yamamoto, S. Nakamura and K. Tanaka: Image Credibility Analysis based on Typicality and Speciality in Related Images (in Japanese), Proc. WebDB Forum 2008, December 2008.
[24]
Y. Yamamoto and K. Tanaka: Set-oriented Credibility Analysis of Web Information, draft, November 2009.
[25]
S. Brin and L. Page: The anatomy of a large-scale hypertextual web search engine, Computer Networks and ISDN Systems, 30:1 7, 1998.
[26]
J. M. Kleinberg: Authoritative sources in a hyperlinked environment. Journal of the ACM, 46(5):604 632, 1999.
[27]
H. Ohshima, S. Oyama, H. Kondo, K. Tanaka: Web Information Credibility Analysis by Geographical Social Support, Proceedings of the 3rd International Universal Communication Symposium, To appear in ACM Digital Library, pp. 193--196, December 2009.
[28]
http://kizasi.jp/labo/nict_h20/
[29]
S. Nakajima, J. Zhang, Y. Inagaki, T. Kusano, and R. Y. Nakamoto: Blog ranking based on bloggers' knowledge level for providing credible information. In WISE, pages 227--234, 2009.
[30]
J. Zhang, Y. Kawai, T. Kumamoto, and K. Tanaka. A novel visualization method for distinction of web news sentiment. In WISE, pages 181--194, 2009.
[31]
X. Zhang, Y. Asano, and M. Yoshikawa: Analysis of implicit relations on Wikipedia: Measuring strength through mining elucidatory objects, in Proceedings of DASFAA 2010(to appear)
[32]
D. Kitayama, R. Lee and K. Sumiya: An Estimation Method of Object Existence based on Temporal Analysis of Web Pages for Digital Maps Credibility, Proc. of 3rd International Workshop for Multimedia Data Mining and Management (MDMM2009), pp.261--265, Sept. 2009
[33]
D. Kitayama, R. Lee and K. Sumiya: A Method of Analyzing Credibility based on LOD Control of Digital Maps, Proc. of 3rd Workshop on Information Credibility on the Web (WICOW2009), pp.11--18, April 2009
[34]
D. Kitayama, R. Lee and K. Sumiya: A Credibility Analyzing Method of Geographical Objects from Digital Maps, Proc. of 3rd International Conference on Ubiquitous Information Management and Communication (ICUIMC2009), pp.536--543, January 2009.
[35]
Xu, L., Ma, Q., and Yoshikawa, M.: Stakeholder Extraction for Inconsistency Analysis of Multimedia News, in Proceedings of WebDB Forum 2009, 4B-1, 2009.
[36]
S. Nakamura, M. Shimizu and K. Tanaka: Can Social Annotation Support Trustworthiness of Video Clips?, Second Workshop on Information Credibility on the Web (WICOW 2008), pages 59--62, 2008.

Cited By

View all

Index Terms

  1. Evaluating credibility of web information

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICUIMC '10: Proceedings of the 4th International Conference on Uniquitous Information Management and Communication
    January 2010
    550 pages
    ISBN:9781605588933
    DOI:10.1145/2108616
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 14 January 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. credibility
    2. trustworthiness
    3. web search

    Qualifiers

    • Research-article

    Funding Sources

    • National Institute of Information and Communications Technology, Japan, by Grants-in-Aid for Scientific Research

    Conference

    ICUIMC '10
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 251 of 941 submissions, 27%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)27
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 05 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media