Article

A data stream language and system designed for power and extensibility

Authors:

Carlo ZanioloAuthors Info & Claims

CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge management

Pages 337 - 346

https://doi.org/10.1145/1183614.1183664

Published: 06 November 2006 Publication History

Abstract

By providing an integrated and optimized support for user-defined aggregates (UDAs), data stream management systems (DSMS) can achieve superior power and generality while preserving compatibility with current SQL standards. This is demonstrated by the Stream Mill system that, through is Expressive Stream Language (ESL), efficiently supports a wide range of applications - including very advanced ones such as data stream mining, streaming XML processing, time-series queries, and RFID event processing. ESL supports physical and logical windows (with optional slides and tumbles) on both built-in aggregates and UDAs, using a simple framework that applies uniformly to both aggregate functions written in an external procedural languages and those natively written in ESL. The constructs introduced in ESL extend the power and generality of DSMS, and are conducive to UDA-specific optimization and efficient execution as demonstrated by several experiments.

References

[1]

Oracle. http://www.oracle.com/technology/documentation/database10gr2.html.

[2]

A. Arasu, S. Babu, and J. Widom. CQL: A language for continuous queries over streams and relations. In DBPL, pages 1--19, 2003.

[3]

Arvind Arasu and Jennifer Widom. Resource sharing in continuous sliding-window aggregates. In VLDB, pages 336--347, 2004.

Digital Library

[4]

B. Babcock, S. Babu, M. Datar, R. Motawani, and J. Widom. Models and issues in data stream systems. In PODS, 2002.

Digital Library

[5]

B. Babcock, M. Datar, and R. Motwani. Sampling from a moving window over streaming data. In SODA, 2002.

Digital Library

[6]

Y. Bai, C. Luo, H. Thakkar, and C. Zaniolo. Efficient support for time series queries in data stream management systems. In Stream Data Management - Chapter 6. N. Chaudhry, K. Shaw and M. Abdelguerfi (EDs.), Kluwer, 2004.

[7]

Y. Bai, H. Thakkar, H. Wang, and C. Zaniolo. Timestamp management and operator scheduling in Stream Mill DSMS. Technical report, Department of Computer Science, UCLA, June 2006.

[8]

D. Barbara. The characterization of continuous queries. Intl. Journal of Cooperative Information Systems, 8(4):295--323, 1999.

[9]

G. Cormode, F. Korn, S. Muthukrishnan, T. Johnson, O. Spatscheck, and D. Srivastava. Holistic UDAFs at streaming speeds. In SIGMOD, 2004.

Digital Library

[10]

C. Cranor, Y. Gao, T. Johnson, V. Shkapenyuk, and O. Spatscheck. Gigascope: High performance network monitoring with an SQL interface. In SIGMOD, page 623. ACM Press, 2002.

Digital Library

[11]

C. Cranor, T. Johnson, O. Spatscheck, V. Shkapenyuk, and O. Spatscheck. Gigascope: A stream database for network applications. In SIGMOD, pages 647--651. ACM Press, 2003.

Digital Library

[12]

M. Datar, A. Gionis, P. Indyk, and R. Motwani. Maintaining stream statistics over sliding windows. In SODA, pages 635--644, 2002.

Digital Library

[13]

C. Jin et al. Dynamically maintaining frequent items over a data stream. In CIKM, 2003.

Digital Library

[14]

D. Abadi et al. Aurora: A new model and architecture for data stream management. VLDB Journal, 12(2):120--139, 2003.

Digital Library

[15]

D. Abadi et al. The design of the borealis stream processing engine. CIDR, 12(2):120--139, 2005.

[16]

D. Carney et al. Monitoring streams - a new class of data management applications. In VLDB, Hong Kong, China, 2002.

Digital Library

[17]

J. Li et al. No pane, no gain: Efficient evaluation of sliding window aggregates over data streams. In SIGMOD, 2005.

Digital Library

[18]

Jim Gray et al. Data cube: A relational aggregation operator generalizing group-by, cross-tab, and sub-totals. J. Data Mining and Knowledge Discovery, 1(1):29--53, 1997.

Digital Library

[19]

Sirish Chandrasekaran et al. Telegraphcq: Continuous dataflow processing for an uncertain world. In CIDR, 2003.

Digital Library

[20]

Theodore Johnson et al. Sampling algorithms in a stream operator. In SIGMOD, pages 1--12, 2005.

Digital Library

[21]

L. Golab and M. T. Özsu. Issues in data stream management. ACM SIGMOD Record, 32(2):5--14, 2003.

Digital Library

[22]

L. Golab and M. T. Özsu. Update-pattern-aware modeling and processing of continuous queries. In SIGMOD, pages 658--669, 2005.

Digital Library

[23]

M. Hammad, W. Aref, M. Franklin, M. Mokbel, and A.K. Elmagarmid. Efficient execution of sliding window queries over data streams. Technical report, Department of Computer Sciences, Purdue University, December 2003.

[24]

Yan-Nei Law, Haixun Wang, and Carlo Zaniolo. Data models and query language for data streams. In VLDB, pages 492--503, 2004.

Digital Library

[25]

C. Luo, H. Thakkar, H. Wang, and C. Zaniolo. A native extension of SQL for mining data streams. In SIGMOD, pages 873--875, 2005.

Digital Library

[26]

Reza Sadri, Carlo Zaniolo, Amir Zarkesh, and Jafar Adibi. Optimization of sequence queries in database systems. In PODS, Santa Barbara, CA, May 2001.

Digital Library

[27]

P. Seshadri, M. Livny, and R. Ramakrishnan. The design and implementation of a sequence database system. In VLDB, 1996.

Digital Library

[28]

Sleepycat Software, http://www.sleepycat.com. The Berkeley Database (Berkeley DB).

[29]

Fusheng Wang, Shaorong Liu, Peiya Liu, and Yijian Bai. Bridging physical and virtual worlds: Complex event processing for RFID data streams. In EDBT, 2006.

Digital Library

[30]

Haixun Wang and Carlo Zaniolo. ATLaS: a native extension of SQL for data minining. In Proceedings of Third SIAM Int. Conference on Data Mining, pages 130--141, 2003.

[31]

Fred Zemke, Krishna Kulkarni, Andy Witkowski, and Bob Lyle. Proposal for OLAP functions. In ISO/IEC JTC1/SC32 WG3:YGJ-nnn, ANSI NCITS H2-99-155, 1999.

[32]

Donghui Zhang, Dimitrios Gunopulos, Vassilis J. Tsotras, and Bernhard Seeger. Temporal aggregation over data streams using multiple granularities. In EDBT, 2002.

Digital Library

[33]

X. Zhou, H. Thakkar, and C. Zaniolo. Unifying the processing of XML streams and relational data streams. In ICDE, 2006.

Digital Library

Cited By

Mamouras K(2020)Semantic Foundations for Deterministic Dataflow and Stream ProcessingProgramming Languages and Systems10.1007/978-3-030-44914-8_15(394-427)Online publication date: 27-Apr-2020
https://dl.acm.org/doi/10.1007/978-3-030-44914-8_15
Alarbi MLutfiyya H(2018)Sensing as a Service Middleware Architecture2018 IEEE 6th International Conference on Future Internet of Things and Cloud (FiCloud)10.1109/FiCloud.2018.00064(399-406)Online publication date: Aug-2018
https://doi.org/10.1109/FiCloud.2018.00064
Zaniolo C(2018)WindowsEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_469(4700-4702)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_469
Show More Cited By

Index Terms

A data stream language and system designed for power and extensibility
1. Information systems
  1. Data management systems
    1. Query languages

Recommendations

Research on data stream clustering algorithms

Data stream is a potentially massive, continuous, rapid sequence of data information. It has aroused great concern and research upsurge in the field of data mining. Clustering is an effective tool of data mining, so data stream clustering will ...
Sequential Patterns Mining Scaling with Data Stream Based on LSP-tree
FSKD '09: Proceedings of the 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery - Volume 05

We present a new method of mining sequential patterns in data stream based on a fast bitmap method. In recent years data stream emerges as a new data type in many applications. When processing data stream, the memory is fixed, new stream elements flow ...
Clustering data stream: A survey of algorithms

A data stream is a massive, continuous and rapid sequence of data elements. The data stream model requires algorithms to make a single pass over the data, with bounded memory and limited processing time, whereas the stream may be highly dynamic and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge management

November 2006

916 pages

ISBN:1595934332

DOI:10.1145/1183614

General Chair:
Philip S. Yu
IBM T.J. Watson Research Center (USA)
,
Program Chairs:
Vassilis Tsotras
University of California-Riverside (USA)
,
Edward Fox
Virginia Tech (USA)
,
Bing Liu
University of Illinois at Chicago (USA)

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CIKM06

Sponsor:

CIKM06: Conference on Information and Knowledge Management

November 6 - 11, 2006

Virginia, Arlington, USA

Acceptance Rates

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

73
Total Citations
View Citations
752
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mamouras K(2020)Semantic Foundations for Deterministic Dataflow and Stream ProcessingProgramming Languages and Systems10.1007/978-3-030-44914-8_15(394-427)Online publication date: 27-Apr-2020
https://dl.acm.org/doi/10.1007/978-3-030-44914-8_15
Alarbi MLutfiyya H(2018)Sensing as a Service Middleware Architecture2018 IEEE 6th International Conference on Future Internet of Things and Cloud (FiCloud)10.1109/FiCloud.2018.00064(399-406)Online publication date: Aug-2018
https://doi.org/10.1109/FiCloud.2018.00064
Zaniolo C(2018)WindowsEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_469(4700-4702)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_469
Aref W(2018)Window-Based Query ProcessingEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_468(4695-4700)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_468
Cherniack MZdonik S(2018)Stream-Oriented Query Languages and OperatorsEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_368(3802-3809)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_368
Patroumpas KAlevizos EArtikis AVodas MPelekis NTheodoridis Y(2017)Online event recognition from moving vessel trajectoriesGeoinformatica10.1007/s10707-016-0266-x21:2(389-427)Online publication date: 1-Apr-2017
https://dl.acm.org/doi/10.1007/s10707-016-0266-x
Zaniolo C(2017)WindowsEncyclopedia of Database Systems10.1007/978-1-4899-7993-3_469-2(1-2)Online publication date: 6-Apr-2017
https://doi.org/10.1007/978-1-4899-7993-3_469-2
Aref W(2017)Window-Based Query ProcessingEncyclopedia of Database Systems10.1007/978-1-4899-7993-3_468-2(1-6)Online publication date: 6-Apr-2017
https://doi.org/10.1007/978-1-4899-7993-3_468-2
Furche TGrasso GHuemer MSchallhart CSchrefl M(2016)PeaCE-Ful Web Event Extraction and Processing as Bitemporal Mutable EventsACM Transactions on the Web10.1145/291198910:3(1-47)Online publication date: 16-Aug-2016
https://dl.acm.org/doi/10.1145/2911989
Macia HValero VDiaz GBoubeta-Puig JOrtiz G(2016)Complex Event Processing Modeling by Prioritized Colored Petri NetsIEEE Access10.1109/ACCESS.2016.26217184(7425-7439)Online publication date: 2016
https://doi.org/10.1109/ACCESS.2016.2621718
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents