article

What makes the differences: benchmarking XML database implementations

Authors:

Aoying ZhouAuthors Info & Claims

ACM Transactions on Internet Technology (TOIT), Volume 5, Issue 1

Pages 154 - 194

https://doi.org/10.1145/1052934.1052940

Published: 01 February 2005 Publication History

Abstract

XML is emerging as a major standard for representing data on the World Wide Web. Recently, many XML storage models have been proposed to manage XML data. In order to assess an XML database's abilities to deal with XML queries, several benchmarks have also been proposed, including XMark and XMach. However, no reported studies using those benchmarks were found that can provide users with insights on the impacts of a variety of storage models on XML query performance. In this article, we report our first set of results on benchmarking a set of XML database implementations using two XML benchmarks. The selected implementations represent a wide range of approaches, including RDBMS-based systems with document-independent and document-dependent XML-relational schema mapping approaches, and XML native engines based on an Object-Oriented Model and the Document Object Model. Comprehensive experiments were conducted to study relative performance of different approaches and the important issues that affect XML query performance, such as path expression query processing, effectiveness of various partitioning, label-path, and indexing structures.

References

[1]

Abiteboul, S., Quass, D., McHugh, J., Widom, J., and Wiener, J. L. 1997. The Lorel query language for semistructured data. International Journal on Digital Libraries 1, 1, 68--88.

[2]

Böhme, T. and Rahm, E. 2001. XMach-1: A benchmark for XML data management. In Proceedings of Datenbanksysteme in Büro, Technik und Wissenschaft (BTW). Oldenburg, Germany, 264--273.

Digital Library

[3]

Berglund, A., Boag, S., Chamberlin, D., Fernandez, M. F., Kay, M., Robie, J., and Simeon, J. 2002. XML path language (XPath) 2.0. Tech. rep.

[4]

Boag, S., Chamberlin, D., Fernandez, M. F., Florescu, D., Robie, J., and Simeon, J. 2002. XQuery 1.0: An XML query language. In W3C Working Draft 16 August 2002.

[5]

Böhme, T. and Rahm, E. 2002. Multi-user evaluation of XML data management systems with xmach-1. In Proceedings of VLDB 2002 Workshop EEXTT Lecture Notes in Computer Science, vol. 2590. 148--159.

Digital Library

[6]

Bonifati, A. and Ceri, S. 2000. Comparative analysis of five XML query languages. SIGMOD Record 29, 1, 68--79.

Digital Library

[7]

Brassan, S., Lee, M. L., Li, Y. G., Lacroix, Z., and Nambiar, U. 2002. The XOO7 benchmark. In Proceedings of Very Large Data Bases 2002 Workshop EEXTT. (Lecture Notes in Computer Science Vol. 2590). 146--147.

Digital Library

[8]

Ceri, S., Comai, S., Damiani, E., Fraternali, P., Paraboschi, S., and Tanca, L. 1999. XML-GL: a graphical language for querying and restructuring XML documents. In Proceedings of the 8th International World Wide Web Conference. (Toronto, Canada). 1171--1187.

Digital Library

[9]

Chamberlin, D. D., Robie, J., and Florescu, D. 2000. Quilt: An XML query language for heterogeneous data sources. In WebDB (Informal Proceedings). 53--62.

Digital Library

[10]

Chien, S. Y., Vagena, Z., Zhang, D., Tsotras, V., and Zaniolo, C. 2002. Efficient structural joins on indexed XML documents. In Proceedings of the 28th International Conference on Very Large Data Bases. Hong Kong, China. 263--274.

Digital Library

[11]

Christophides, V., Abiteboul, S., Cluet, S., and Scholl, M. 1994. From structured documents to novel query facilities. In Proceedings of the ACM SIGMOD International Conference on Management of Data. Minneapolis, MN. 313--324.

Digital Library

[12]

Deutsch, A., Fernandez, M., and Florescu, D. 1999. A query language for XML. In Proceedings of the 8th International World Wide Web Conference. Toronto, Canada. 1155--1169.

Digital Library

[13]

Deutsch, A., Fernandez, M. F., and Suciu, D. 1999. Storing semistructured data with STORED. In Proceedings of the ACM SIGMOD International Conference on Management of Data. Philadelphia, PA. 431--442.

Digital Library

[14]

Fernandez, M. F., Florescu, D., Kang, J., Levy, A. Y., and Suciu, D. 1998. Catching the boat with strudel: Experiences with a web-site management system. In Proceedings of the ACM SIGMOD International Conference on Management of Data. Seattle, WA. 414--425.

Digital Library

[15]

Florescu, D. and Kossmann, D. 1999. A performance evaluation of alternative mapping schemes for storing XML data in a relational database. Survey report.

[16]

Grust, T. 2002. Accelerating xpath location steps. In Proceedings of the ACM SIGMOD International Conference on Data Management of Data. 109--120.

Digital Library

[17]

Jiang, H., Lu, H., Wang, W., and Yu, J. X. 2002a. Path materialization revisited: An efficient storage model for XML data. In Proceedings of the 13th Australasian Database Conference (ADC2002). (Melbourne, Australia). 85--94.

Digital Library

[18]

Jiang, H., Lu, H., Wang, W., and Yu, J. X. 2002b. XParent: An efficient RDBMS-based XML database system. In Proceedings of the 18th International Conference on Data Engineering. (San Jose, CA). 335--336.

Digital Library

[19]

Kanda Runapongsa, Jignesh M. Patel, H. J. and Al-Khalifa, S. 2002. The Michigan benchmark: A microbenchmark for XML query processing systems. In Proceedings of Very Large Data Bases 2002 Workshop EEXTT. (Lecture Notes in Computer Science Vol. 2590). 160--161.

Digital Library

[20]

Kanne, C. C. and Moerkotte, G. 2000. Efficient storage of XML data. In Proceedings of the 16th International Conference on Data Engineering. (San Diego, CA). 198--198.

Digital Library

[21]

Kha, D. D., Yoshikawa, M., and Uemura, S. 2001. An XML indexing structure with relative region coordinate. In Proceedings of the 17th International Conference on Data Engineering. (Heidelberg, Germany). 313--320.

Digital Library

[22]

Lee, D. and Chu, W. W. 2000. Comparative analysis of six XML schema languages. SIGMOD Record 29, 3, 76--87.

Digital Library

[23]

Li, Q. and Moon, B. 2001. Indexing and querying XML data for regular path expressions. In Proceedings of the 27th International Conference on Very Large Data Bases. (Rome, Italy). 361--370.

Digital Library

[24]

Lu, H., Wang, G., Yu, G., Bao, Y., Lv, J., and Yu, Y. 2002. XBase: Making your gigabyte disk files queriable. In Proceedings of the ACM SIGMOD International Conference on Management of Data. (Madison, WI). 630--630.

Digital Library

[25]

Lv, J., Wang, G., Yu, J. X., Yu, G., Lu, H., and Sun, B. 2002. Performance evaluation of a Dom-based xml database: Storage, indexing, and query optimization. In Proceedings of the 3rd International Conference on Web-Age Information Management. (Lecture Notes in Computer Science Vol. 2419). 13--24.

Digital Library

[26]

McHugh, J., Abiteboul, S., Goldman, R., Quass, D., and Widom, J. 1997. Lore: A database management system for semistructured data. SIGMOD Record 26, 3, 54--66.

Digital Library

[27]

Schmidt, A., Kersten, M. L., Windhouwer, M., and Waas, F. 2000. Efficient relational storage and retrieval of XML documents. In International Workshop on the Web and Databases (Informal Proceedings). 47--52.

Digital Library

[28]

Schmidt, A., Waas, F., Kersten, M., Carey, M. J., Manolescu, I., and Busse, R. 2002. Xmark: A benchmark for XML data management. In Proceedings of the 28th International Conference on Very Large Data Bases. (Hong Kong, China). 974--985.

Digital Library

[29]

Schmidt, A., Waas, F., Kersten, M., Florescu, D., Manolescu, L., Carey, M. J., and Busse, R. 2001. The XML benchmark project. Tech. rep., CWI, Amsterdam, The Netherlands.

Digital Library

[30]

Shanmugasundaram, J., Tufte, K., Zhang, C., Gang, H., DeWitt, D. J., and Naughton, J. F. 1999. Relational databases for querying XML documents: Limitations and opportunities. In Proceedings of the 25th International Conference on Very Large Data Bases. (Edinburgh, Scotland) UK. 302--314.

Digital Library

[31]

Srivastava, D., Al-Khalifa, S., Jagadish, H. V., Koudas, N., Patel, J. M., and Yuqing, W. U. 2002. Structural joins: A primitive for efficient XML query pattern matching. In Proceedings of the 18th International Conference on Data Engineering. (San Jose, CA). 141--152.

Digital Library

[32]

Tian, F., DeWitt, D. J., Chen, J., and Zhang, C. 2000. The design and performance evaluation of altervative XML storage strategies. Tech. rep., Computer Science Department, University of Wisconsin, Madison, WI.

[33]

W3C. Document object model (DOM). http://www.w3.org/DOM/.

[34]

Yao, B. B., Özsu, M. T., and Keenleyside, J. 2002. XBench---A family of benchmarks for XML DBMSs. In Proceedings of Very Large Data Bases 2002 Workshop EEXTT. (Lecture Notes in Computer Science Vol. 2590). 162--163.

Digital Library

[35]

Yoshikawa, M., Amagasa, T., Shimura, T., and Uemura, S. 2001. XRel: A path-based approach to storage and retrieval of XML documents using relational databases. ACM Trans. Intern. Tech. 1, 1, 110--141.

Digital Library

[36]

Zhang, C., Naughton, J. F., DeWitt, D. J., Luo, Q., and Lohman, G. M. 2001. On supporting containment queries in relational database management systems. In Proceedings of the ACM SIGMOD International Conference on Management of Data. (Santa Barbara, CA). 425--436.

Digital Library

[37]

Zhou, A., Lu, H., Zheng, S., Liang, Y., Zhang, L., Ji, W., and Tian, Z. 2001. VXMLR: A visual XML-relational database system. In Proceedings of the 27th International Conference on Very Large Data Bases. (Rome, Italy). 719--720.

Digital Library

Cited By

Barbosa DManolescu IYu J(2018)XML BenchmarksEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_789(4739-4742)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_789
Schweinsberg KWegner L(2017)Advantages of complex SQL types in storing XML documentsFuture Generation Computer Systems10.1016/j.future.2016.02.01368(500-507)Online publication date: Mar-2017
https://doi.org/10.1016/j.future.2016.02.013
Barbosa DManolescu IYu J(2016)XML BenchmarksEncyclopedia of Database Systems10.1007/978-1-4899-7993-3_789-2(1-4)Online publication date: 15-Dec-2016
https://doi.org/10.1007/978-1-4899-7993-3_789-2
Show More Cited By

Index Terms

What makes the differences: benchmarking XML database implementations
1. Information systems
  1. Information retrieval
    1. Evaluation of retrieval results

Recommendations

Efficiently Querying Large XML Data Repositories: A Survey

Extensible Markup Language (XML) is emerging as a de facto standard for information exchange among various applications on the World-Wide Web. There has been a growing need for developing high-performance techniques to query large XML data repositories ...
Algebraic incremental maintenance of XML views
EDBT/ICDT '11: Proceedings of the 14th International Conference on Extending Database Technology

Materialized views can bring important performance benefits when querying XML documents. In the presence of XML document changes, materialized views need to be updated to faithfully reflect the changed document. In this work, we present an algebraic ...
Processing and Evaluating Partial Tree Pattern Queries on XML Data

XML query languages typically allow the specification of structural patterns using XPath. Usually, these structural patterns are in the form of trees (Tree-Pattern Queries—TPQs). Finding the occurrences of such patterns in an XML tree is a key operation ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Internet Technology

ACM Transactions on Internet Technology Volume 5, Issue 1

February 2005

297 pages

ISSN:1533-5399

EISSN:1557-6051

DOI:10.1145/1052934

Issue’s Table of Contents

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 February 2005

Published in TOIT Volume 5, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
2,464
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)1

Reflects downloads up to 28 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Barbosa DManolescu IYu J(2018)XML BenchmarksEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_789(4739-4742)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_789
Schweinsberg KWegner L(2017)Advantages of complex SQL types in storing XML documentsFuture Generation Computer Systems10.1016/j.future.2016.02.01368(500-507)Online publication date: Mar-2017
https://doi.org/10.1016/j.future.2016.02.013
Barbosa DManolescu IYu J(2016)XML BenchmarksEncyclopedia of Database Systems10.1007/978-1-4899-7993-3_789-2(1-4)Online publication date: 15-Dec-2016
https://doi.org/10.1007/978-1-4899-7993-3_789-2
Schweinsberg KWegner L(2014)Mapping XML Documents Using Complex SQL Data TypesModel and Data Engineering10.1007/978-3-319-11587-0_20(209-223)Online publication date: 2014
https://doi.org/10.1007/978-3-319-11587-0_20
Li FLuo BLiu PLee DChu C(2013)Enforcing Secure and Privacy-Preserving Information Brokering in Distributed Information SharingIEEE Transactions on Information Forensics and Security10.1109/TIFS.2013.22473988:6(888-900)Online publication date: 1-Jun-2013
https://dl.acm.org/doi/10.1109/TIFS.2013.2247398
Bukatovič MHorák ARambousek A(2010)Which XML storage for knowledge and ontology systems?Proceedings of the 14th international conference on Knowledge-based and intelligent information and engineering systems: Part I10.5555/1893893.1893946(432-441)Online publication date: 8-Sep-2010
https://dl.acm.org/doi/10.5555/1893893.1893946
Bukatovič MHorák ARambousek A(2010)Which XML Storage for Knowledge and Ontology Systems?Knowledge-Based and Intelligent Information and Engineering Systems10.1007/978-3-642-15387-7_47(432-441)Online publication date: 2010
https://doi.org/10.1007/978-3-642-15387-7_47
Lee KMoon BCheung DSong IChu WHu XLin J(2009)Bitmap indexes for relational XML twig query processingProceedings of the 18th ACM conference on Information and knowledge management10.1145/1645953.1646014(465-474)Online publication date: 2-Nov-2009
https://dl.acm.org/doi/10.1145/1645953.1646014
Moreira LSousa FMachado J(2009)A Distributed Concurrency Control Mechanism for XML DataProceedings of the 2009 International Conference on Parallel Processing Workshops10.1109/ICPPW.2009.45(595-602)Online publication date: 22-Sep-2009
https://dl.acm.org/doi/10.1109/ICPPW.2009.45
Haw SLee C(2009)Extending path summary and region encoding for efficient structural query processing in native XML databasesJournal of Systems and Software10.1016/j.jss.2009.01.00782:6(1025-1035)Online publication date: 1-Jun-2009
https://dl.acm.org/doi/10.1016/j.jss.2009.01.007
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents