Article

Combining DOM tree and geometric layout analysis for online medical journal article segmentation

Authors:

George R. ThomaAuthors Info & Claims

JCDL '06: Proceedings of the 6th ACM/IEEE-CS joint conference on Digital libraries

Pages 119 - 128

https://doi.org/10.1145/1141753.1141777

Published: 11 June 2006 Publication History

Abstract

We describe an HTML web page segmentation algorithm, which is applied to segment online medical journal articles (regular HTML and PDF-Converted-HTML files). The web page content is modeled by a zone tree structure based primarily on the geometric layout of the web page. For a given journal article, a zone tree is generated by combining DOM tree analysis and recursive X-Y cut algorithm. Combining with other visual cues, such as background color, font size, font color and so on, the page is segmented into homogeneous regions. Evaluation is conducted with 104 articles from 11 journals. Out of 9726 ground-truth zones, 9376 zones are correctly segmented, for an accuracy of 96.40%. Segmenting the entire web page into zones can significantly expedite and increase the accuracy of the subsequent information retrieval steps.

References

[1]

Baird, H.S., Jones, S.E., and Fortune, S.J., Image Segmentation by Shape-Directed Covers, Proc. International Conference Pattern Recognition, pp. 820--825, 1990.

[2]

Buyukkokten, O., Garcia Molina, H., and Paepche, A., Accordion Summary for End-Game Browsing on PDAs and Cellular Phones, Proc. of Conference on Human Factors in Computer Systems, 2001.

Digital Library

[3]

Cai, D., Yu, S., Wen, J. R., and Ma, W. Y., Extracting Content Structure for Web Pages Based on Visual Representation, Proc. of 5th Asia Pacific Web Conference, 2003.

Digital Library

[4]

Cai, D., Yu, S., Wen J. R., and Ma, W. Y., VIPS: a Vision-Based Page Segmentation Algorithm, Microsoft Technical Report (MSR-TR-2003-79), 2003.

[5]

Chen, J., Zhou, B., Shi, J., Zhang, H., and Wu, Q., Function-Based Object Model towards Website Adaptation, Proc. 10th International World Wide Web Conference, 2001.

Digital Library

[6]

Diao, Y., Lu, H., Chen, S., and Tian, Z., Toward Learning Based Web Query Processing, Proc. of International Conference on Very Large Databases, pp. 317--328, 2000.

Digital Library

[7]

Ha, J., Haralick, R., and Phillips, I., Recursive X-Y Cut Using Bounding Boxes of Connected Components, Proc. 3rd International Conference Document Analysis and Recognition, pp. 952--955, 1995.

Digital Library

[8]

Hauser, S.E., Le D.X., and Thoma G.R., Automated zone correction in bitmapped document images, Proc. SPIE: Document Recognition and Retrieval VII, SPIE Vol. 3976, San Jose, CA, pp. 248--258, 2000.

[9]

Jain, A.K. and Yu B., Document Representation and Its Application to Page Decomposition, IEEE Trans. Pattern Recognition and Machine Intelligence, vol. 20, no. 3, pp. 294--308, 1998.

Digital Library

[10]

Kaasinen, E., Aaltonen, M., Kolari, J., Melakoski, S., and Laakko, T., Two Approaches to Bringing Internet Services to WAP Devices, Proc. 9th International World Wide Web Conference, pp. 231--246, 2000.

Digital Library

[11]

Lin, S. H., and Ho, J. M., Discovering Informative Content Blocks from Web Documents, Proc. of ACM SIGKDD, 2002.

Digital Library

[12]

Marini, J., The Document Object Model, Processing Structured Documents, McGraw-Hill/Osborne, 2002.

Digital Library

[13]

Nagy, G., Seth, S., and Viswanathan, M., A Prototype Document Image Analysis System for Technical Journals, Computer, vol. 25, pp. 10--22, 1992.

Digital Library

[14]

Nagy, G., Twenty Years of Document Image Analysis in PAMI, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 1, pp.38--62, 2000.

Digital Library

[15]

O'Gorman, L., The Document Spectrum for Page Layout Analysis, IEEE Trans. Pattern Recognition and Machine Intelligence, vol. 15, pp. 1162--1173, 1993.

Digital Library

[16]

Pavlidis, T., and Zhou, J., Page Segmentation and Classification, Graphical Models and Image Processing, vol. 54, pp. 484--496, 1992.

Digital Library

[17]

http://www.w3.org/DOM/

[18]

http://pdftohtml.sourceforge.net/

Cited By

Chaudhary MPooja Chandwani G(2024)Unveiling Insights: Vision-Based Data Mining Analysis of Webpages in Transition from HTML 3 to HTML 52024 IEEE International Conference on Computing, Power and Communication Technologies (IC2PCT)10.1109/IC2PCT60090.2024.10486413(1646-1651)Online publication date: 9-Feb-2024
https://doi.org/10.1109/IC2PCT60090.2024.10486413
Sarode RSachdeva SChu WBhalla S(2019)Segment-Search vs Knowledge Graphs: Making a Key-Word Search Engine for Web DocumentsBig Data Analytics10.1007/978-3-030-37188-3_6(88-107)Online publication date: 12-Dec-2019
https://doi.org/10.1007/978-3-030-37188-3_6
Pagi VWadawadagi R(2017)Opinion Content Extraction from Web Pages Using Embedded Semantic Term Tree KernelsProceedings of International Conference on Computational Intelligence and Data Engineering10.1007/978-981-10-6319-0_29(345-358)Online publication date: 21-Dec-2017
https://doi.org/10.1007/978-981-10-6319-0_29
Show More Cited By

Index Terms

Combining DOM tree and geometric layout analysis for online medical journal article segmentation
1. Applied computing
  1. Computers in other domains
    1. Digital libraries and archives
  2. Document management and text processing
    1. Document capture
      1. Document analysis
2. Information systems
  1. Information retrieval
    1. Document representation
    2. Search engine architectures and scalability
      1. Search engine indexing
  2. Information systems applications
    1. Digital libraries and archives

Recommendations

Structure and content analysis for html medical articles: a hidden markov model approach
DocEng '07: Proceedings of the 2007 ACM symposium on Document engineering

We describe ongoing research on segmenting and labeling HTML medical journal articles. In contrast to existing approaches in which HTML tags usually serve as strong indicators, we seek to minimize dependence on HTML tags. Designing logical component ...
Improving pseudo-relevance feedback in web information retrieval using web page segmentation
WWW '03: Proceedings of the 12th international conference on World Wide Web

In contrast to traditional document retrieval, a web page as a whole is not a good information unit to search because it often contains multiple topics and a lot of irrelevant information from navigation, decoration, and interaction part of the page. In ...
Layout cross-browser incompatibility detection using machine learning and DOM segmentation
SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied Computing

Cross-Browser Incompatibilities, namely XBIs, are differences in the behavior of web applications as they are rendered in distinct browser implementations. Web applications can be rendered in a wide variety of configuration environments, varying their ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

JCDL '06: Proceedings of the 6th ACM/IEEE-CS joint conference on Digital libraries

June 2006

402 pages

ISBN:1595933549

DOI:10.1145/1141753

General Chair:
Gary Marchionini
University of North Carolina, Chapel Hill
,
Program Chairs:
Michael L. Nelson
Old Dominion University
,
Catherine C. Marshall
Microsoft

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 June 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

JCDL06

Sponsor:

JCDL06: Joint Conference on Digital Libraries 2006

June 11 - 15, 2006

NC, Chapel Hill, USA

Acceptance Rates

Overall Acceptance Rate 415 of 1,482 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
552
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chaudhary MPooja Chandwani G(2024)Unveiling Insights: Vision-Based Data Mining Analysis of Webpages in Transition from HTML 3 to HTML 52024 IEEE International Conference on Computing, Power and Communication Technologies (IC2PCT)10.1109/IC2PCT60090.2024.10486413(1646-1651)Online publication date: 9-Feb-2024
https://doi.org/10.1109/IC2PCT60090.2024.10486413
Sarode RSachdeva SChu WBhalla S(2019)Segment-Search vs Knowledge Graphs: Making a Key-Word Search Engine for Web DocumentsBig Data Analytics10.1007/978-3-030-37188-3_6(88-107)Online publication date: 12-Dec-2019
https://doi.org/10.1007/978-3-030-37188-3_6
Pagi VWadawadagi R(2017)Opinion Content Extraction from Web Pages Using Embedded Semantic Term Tree KernelsProceedings of International Conference on Computational Intelligence and Data Engineering10.1007/978-981-10-6319-0_29(345-358)Online publication date: 21-Dec-2017
https://doi.org/10.1007/978-981-10-6319-0_29
Madaan AChu W(2014)Handling Domain Specific Document Repositories for Application of Query LanguagesProceedings of the 9th International Workshop on Databases in Networked Information Systems - Volume 838110.1007/978-3-319-05693-7_10(152-167)Online publication date: 24-Mar-2014
https://dl.acm.org/doi/10.1007/978-3-319-05693-7_10
Goslin KHofmann M(2013)Cross Domain Assessment of Document to HTML Conversion Tools to Quantify Text and Structural Loss during Document AnalysisProceedings of the 2013 European Intelligence and Security Informatics Conference10.1109/EISIC.2013.22(100-105)Online publication date: 12-Aug-2013
https://dl.acm.org/doi/10.1109/EISIC.2013.22
Chen WChang R(2012)Automatic Web-Based EFP Studio System with XML DocumentsProceedings of the 2012 26th International Conference on Advanced Information Networking and Applications Workshops10.1109/WAINA.2012.195(154-159)Online publication date: 26-Mar-2012
https://dl.acm.org/doi/10.1109/WAINA.2012.195
Bruno EFaessel NGlotin HLe Maitre JScholl M(2011)Indexing and querying segmented web pagesWorld Wide Web10.1007/s11280-011-0124-614:5-6(623-649)Online publication date: 1-Oct-2011
https://dl.acm.org/doi/10.1007/s11280-011-0124-6
Yong Zhang Ke Deng (2010)Algorithm of web page purification based on improved DOM and statistical learning2010 International Conference On Computer Design and Applications10.1109/ICCDA.2010.5541132(V5-288-V5-291)Online publication date: Jun-2010
https://doi.org/10.1109/ICCDA.2010.5541132
Snášel VKudělka MHorák Z(2010)Web Content Mining Using MicroGenresAdvanced Techniques in Web Intelligence - I10.1007/978-3-642-14461-5_4(79-111)Online publication date: 2010
https://doi.org/10.1007/978-3-642-14461-5_4
Bruno EFaessel NGlotin HLe Maitre JScholl MBorghoff UChidlovskii B(2009)Indexing by permeability in block structured web pagesProceedings of the 9th ACM symposium on Document engineering10.1145/1600193.1600209(70-73)Online publication date: 16-Sep-2009
https://dl.acm.org/doi/10.1145/1600193.1600209
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten