Article

Query processing of streamed XML data

Authors:

Leonidas Fegaras,

Vamsi ChaluvadiAuthors Info & Claims

CIKM '02: Proceedings of the eleventh international conference on Information and knowledge management

Pages 126 - 133

https://doi.org/10.1145/584792.584816

Published: 04 November 2002 Publication History

Abstract

We are addressing the efficient processing of continuous XML streams, in which the server broadcasts XML data to multiple clients concurrently through a multicast data stream, while each client is fully responsible for processing the stream. In our framework, a server may disseminate XML fragments from multiple documents in the same stream, can repeat or replace fragments, and can introduce new fragments or delete invalid ones. A client uses a light-weight database based on our proposed XML algebra to cache stream data and to evaluate XML queries against these data. The synchronization between clients and servers is achieved through annotations and punctuations transmitted along with the data streams. We are presenting a framework for processing XML queries in XQuery form over continuous XML streams. Our framework is based on a novel XML algebra and a new algebraic optimization framework based on query decorrelation, which is essential for non-blocking stream processing.

References

[1]

S. Acharya, R. Alonso, M. Franklin, and S. Zdonik. Broadcast Disks: Data Management for Asymmetric Communications Environments. In ACM SIGMOD International Conference on Management of Data, San Jose, California, pages 199--210, May 1995.]]

Digital Library

[2]

S. Babu and J. Widom. Continuous Queries Over Data Streams. SIGMOD Record, 30(3):109--120, September 2001.]]

Digital Library

[3]

C. Beeri and Y. Tzaban. SAL: An Algebra for Semistructured Data and XML. In ACM SIGMOD Workshop on The Web and Databases (WebDB'99), Philadelphia, Pennsylvania, pages 37--42, June 1999.]]

[4]

P. Buneman, S. Davidson, G. Hillebrand, and D. Suciu. A Query Language and Optimization Techniques for Unstructured Data. In ACM SIGMOD International Conference on Management of Data, Montreal, Canada, pages 505--516, May 1996.]]

Digital Library

[5]

P. Buneman, L. Libkin, D. Suciu, V. Tannen, and L. Wong. Comprehension Syntax. SIGMOD Record, 23(1):87--96, March 1994.]]

Digital Library

[6]

D. Chamberlin, D. Florescu, J. Robie, J. Simeon, and M. Stefanescu. XQuery: A Query Language for XML. Available at http://www.w3.org/TR/xquery/, 2000.]]

[7]

V. Christophides, S. Cluet, and J. Siméon. On Wrapping Query Languages and Efficient XML Integration. In ACM SIGMOD International Conference on Management of Data, Dallas, Texas, pages 141--152, May 2000.]]

Digital Library

[8]

S. Cluet, C. Delobel, J. Simeon, and K. Smaga. Your Mediators Need Data Conversion! In ACM SIGMOD International Conference on Management of Data, Seattle, Washington, pages 177--188, June 1998.]]

Digital Library

[9]

S. Cluet and G. Moerkotte. Nested Queries in Object Bases. In Workshop on Database Programming Languages, Gubbio, Italy, September 1995.]]

Digital Library

[10]

L. Fegaras and R. Elmasri. Query Engines for Web-Accessible XML Data. In VLDB Conference, Roma, Italy, pages 251--260, 2001.]]

Digital Library

[11]

L. Fegaras and D. Maier. Optimizing Object Queries Using an Effective Calculus. ACM Transactions on Database Systems, 25(4):457--516, December 2000.]]

Digital Library

[12]

M. Fernandez, J. Simeon, and P. Wadler. An Algebra for XML Query. In FST TCS, Delhi, December 2000.]]

Digital Library

[13]

D. Florescu, A. Levy, and A. Mendelzon. Database Techniques for the World-Wide Web: A Survey. SIGMOD Record, 27(3):59--74, 1998.]]

Digital Library

[14]

J. Hellerstein, P. Haas, and H. Wang. Online Aggregation. In ACM SIGMOD International Conference on Management of Data, Tucson, Arizona, pages 171--182, May 1997.]]

Digital Library

[15]

Z. Ives, A. Levy, and D. Weld. Efficient Evaluation of Regular Path Expressions on Streaming XML Data. Technical report, University of Washington, 2000. Technical Report UW-CSE-2000-05-02.]]

[16]

A. Wilschut and P. Apers. Dataflow Query Execution in a Parallel Main-Memory Environment. In First International Conference on Parallel and Distributed Information Systems, Miami Beach, Florida, pages 68--77, December 1991.]]

Digital Library

[17]

World Wide Web Consortium (W3C). Extensible Markup Language (XML). http://www.w3.org/XML/.]]

Cited By

Chen RWang ZHong Y(2021)Pipelined XPath Query Based on Cost OptimizationScientific Programming10.1155/2021/55599412021(1-16)Online publication date: 27-May-2021
https://doi.org/10.1155/2021/5559941
Belyaev KRay I(2015)Towards Efficient Dissemination and Filtering of XML Data Streams2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing10.1109/CIT/IUCC/DASC/PICOM.2015.278(1870-1877)Online publication date: Oct-2015
https://doi.org/10.1109/CIT/IUCC/DASC/PICOM.2015.278
Choi RWong R(2015)VXQInformation Systems Frontiers10.1007/s10796-013-9480-317:4(961-981)Online publication date: 1-Aug-2015
https://dl.acm.org/doi/10.1007/s10796-013-9480-3
Show More Cited By

Index Terms

Query processing of streamed XML data
1. Information systems
  1. Data management systems
    1. Database management system engines
      1. Database query processing
  2. Information retrieval
    1. Information retrieval query processing
2. Theory of computation
  1. Theory and algorithms for application domains
    1. Database theory
      1. Database query processing and optimization (theory)

Recommendations

XLight, An Efficient Relational Schema to Store and Query XML Data
DSDE '10: Proceedings of the 2010 International Conference on Data Storage and Data Engineering

Because of increasing use of XML data on the internet, the need for an efficient method of storing and querying XML data is vital. So far, two major types of system for XML data management have been introduced: XML Enabled systems and XML native ...
XML Processing and Data Integration with XQuery

Most Web applications exchange data as XML, but they create and process this data with languages that don't have native support for XML. With appropriate middleware, XQuery can dramatically simplify this process, treating all data sources as though they ...
An XML query engine for network-bound data

XML has become the lingua franca for data exchange and integration across administrative and enterprise boundaries. Nearly all data providers are adding XML import or export capabilities, and standard XML Schemas and DTDs are being promoted for all ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '02: Proceedings of the eleventh international conference on Information and knowledge management

November 2002

704 pages

ISBN:1581134924

DOI:10.1145/584792

General Chair:
Charles Nicholas
University of Maryland Baltimore County
,
Program Chairs:
David Grossman
Illinois Institute of Technology
,
Konstantinos Kalpakis
University of Maryland Baltimore County
,
Sajda Qureshi
Erasmus University, Rotterdam
,
Han van Dissel
Erasmus University, Rotterdam
,
Len Seligman
The MITRE Corporation

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CIKM02

Sponsor:

CIKM02: Eleventh ACM International Conference on Information and Knowledge Management

November 4 - 9, 2002

Virginia, McLean, USA

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

64
Total Citations
View Citations
1,102
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chen RWang ZHong Y(2021)Pipelined XPath Query Based on Cost OptimizationScientific Programming10.1155/2021/55599412021(1-16)Online publication date: 27-May-2021
https://doi.org/10.1155/2021/5559941
Belyaev KRay I(2015)Towards Efficient Dissemination and Filtering of XML Data Streams2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing10.1109/CIT/IUCC/DASC/PICOM.2015.278(1870-1877)Online publication date: Oct-2015
https://doi.org/10.1109/CIT/IUCC/DASC/PICOM.2015.278
Choi RWong R(2015)VXQInformation Systems Frontiers10.1007/s10796-013-9480-317:4(961-981)Online publication date: 1-Aug-2015
https://dl.acm.org/doi/10.1007/s10796-013-9480-3
Choi RWong R(2011)Scalable XML Filtering for Content SubscriptionsTheoretical and Practical Advances in Information Systems Development10.4018/978-1-60960-521-6.ch007(120-152)Online publication date: 2011
https://doi.org/10.4018/978-1-60960-521-6.ch007
Okorodudu AFegaras LLevine D(2010)A scalable and self-adapting notification frameworkProceedings of the 21st international conference on Database and expert systems applications: Part II10.5555/1887568.1887614(452-461)Online publication date: 30-Aug-2010
https://dl.acm.org/doi/10.5555/1887568.1887614
Liu ZNatarajan SHe BHsiao HChen Y(2010)CODSProceedings of the VLDB Endowment10.14778/1920841.19210283:1-2(1521-1524)Online publication date: 1-Sep-2010
https://dl.acm.org/doi/10.14778/1920841.1921028
Haritsa J(2010)The Picasso database query optimizer visualizerProceedings of the VLDB Endowment10.14778/1920841.19210273:1-2(1517-1520)Online publication date: 1-Sep-2010
https://dl.acm.org/doi/10.14778/1920841.1921027
Si XChang EGyöngyi ZSun M(2010)Confucius and its intelligent disciplesProceedings of the VLDB Endowment10.14778/1920841.19210253:1-2(1505-1516)Online publication date: 1-Sep-2010
https://dl.acm.org/doi/10.14778/1920841.1921025
Wei MRundensteiner EMani M(2010)Achieving high output quality under limited resources through structure-based spilling in XML streamsProceedings of the VLDB Endowment10.14778/1920841.19209983:1-2(1267-1278)Online publication date: 1-Sep-2010
https://dl.acm.org/doi/10.14778/1920841.1920998
Zhang SMamoulis NCheung DKao B(2010)Efficient skyline evaluation over partially ordered domainsProceedings of the VLDB Endowment10.14778/1920841.19209963:1-2(1255-1266)Online publication date: 1-Sep-2010
https://dl.acm.org/doi/10.14778/1920841.1920996
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten