Article

An incremental maintenance scheme of data cubes

Authors:

Takayuki Tsuchida,

Ken HiguchiAuthors Info & Claims

DASFAA'08: Proceedings of the 13th international conference on Database systems for advanced applications

Pages 172 - 187

Published: 19 March 2008 Publication History

Abstract

Data cube construction is a commonly used operation in data warehouses. Because of the volume of data stored and analyzed in a data warehouse and the amount of computation involved in data cube construction, incremental maintenance of data cube is really effective. To maintain a data cube incrementally, previous methods were mainly for relational databases. In this paper, we employ an extendible multidimensional array model to maintain data cubes. Such an array enables incremental cube maintenance without relocating any data dumped at an earlier time, while computing the data cube efficiently by utilizing the fast random accessing capability of arrays. Our data cube scheme and related maintenance methods are presented in this paper, and cost analysis on our approach is shown and compared with existing methods.

References

[1]

Rosenberg, A.L.: Allocating Storage for Extendible Arrays. JACM 21, 652-670 (1974).

Digital Library

[2]

Rosenberg, A.L., Stockmeyer, L.J.: Hashing Schemes for Extendible Arrays. JACM 24, 199-221 (1977).

Digital Library

[3]

Hurtado, C.A., Mendelzon, A.O., Vaisman, A.A.: Maintaining Data Cubes under Dimension Updates. In: Proc. of the ICDE Conference, pp. 346-355 (1999).

Digital Library

[4]

Otoo, E.J., Merrett, T.H.: A Storage Scheme for Extendible Arrays. Computing 31, 1-9 (1983).

[5]

Li, H., Huang, H., Lin, Y.: DSD: Maintain Data Cubes More Efficiently. Fundam. Inform. 59(2-3), 173-190 (2004).

Digital Library

[6]

Mumick, I.S., Quass, D., Mumick, B.S.: Maintenance of Data Cubes and Summary Tables in a Warehouse. In: Proc. of the ACM SIGMOD Conference, pp. 100-111 (1997).

Digital Library

[7]

Gray, J., Bosworth, A., Layman, A., Pirahesh, H.: Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Totals. In: Proc. of the ICDE Conference, pp. 152-159 (1996).

Digital Library

[8]

Hasan, K.M.A., Kuroda, M., Azuma, N., Tsuji, T., Higuchi, K.: An Extendible Array Based Implementation of Relational Tables for Multidimensional Databases. In: Tjoa, A.M., Trujillo, J. (eds.) DaWaK 2005. LNCS, vol. 3589, pp. 233-242. Springer, Heidelberg (2005).

Digital Library

[9]

Lee, K.Y., Kim, M.H.: Efficient Incremental Maintenance of Data Cubes. In: Proc. of the VLDB Conference, pp. 823-833 (2006).

Digital Library

[10]

Riedewald, M., Agrawal, D., Abbadi, A.E.: Flexible Data Cubes for Online Aggregation. In: Van den Bussche, J., Vianu, V. (eds.) ICDT 2001. LNCS, vol. 1973, pp. 159-173. Springer, Heidelberg (2001).

Digital Library

[11]

Riedewald, M., Agrawal, D., Abbadi, A.E., Pajarola, R.: Space-Efficient Data Cubes for Dynamic Environments. In: Kambayashi, Y., Mohania, M., Tjoa, A.M. (eds.) DaWaK 2000. LNCS, vol. 1874, pp. 24-33. Springer, Heidelberg (2000).

Digital Library

[12]

Roussopoulos, N., Kotidis, Y., Roussopoulos, M.: Cubetree: Organization of and Bulk Incremental Updates on the Data Cube. In: Proc. of the ACM SIGMOD Conference, pp. 89- 99 (1997).

Digital Library

[13]

Jin, R., Yang, G., Vaidyanathan, K., Agrawal, G.: Communication and Memory Optimal Parallel Data Cube Construction. IEEE Transactions On Parallel and Distributed Systems 16(12), 1105-1119 (2005).

Digital Library

[14]

Agarwal, S., Agrawal, R., Deshpande, P.M., Gupta, A., Naughton, J.F., Ramakrishnan, R., Sarawagi, S.: On the Computation of Multidimensional Aggregates. In: Proc. of the VLDB Conference, pp. 506-521 (1996).

Digital Library

[15]

Geffner, S., Agrawal, D., Abbadi, A.E.: The Dynamic Data Cube. In: Zaniolo, C., Grust, T., Scholl, M.H., Lockemann, P.C. (eds.) EDBT 2000. LNCS, vol. 1777, pp. 237-253. Springer, Heidelberg (2000).

Digital Library

[16]

Geffner, S., Riedewald, M., Agrawal, D., Abbadi, A.E.: Data Cubes in Dynamic Environments. IEEE Data Eng. Bull. 22(4), 31-40 (1999).

[17]

Harinarayan, V., Rajaraman, A., Ullman, J.D.: Implementing Data Cubes Efficiently. In: Proc. of the ACM SIGMOD Conference, pp. 205-216 (1996).

Digital Library

[18]

Lehner, W., Sidle, R., Pirahesh, H., Cochrane, R.: Maintenance of Cube Automatic Summary Tables. In: Proc. of the ACM SIGMOD Conference, pp. 512-513 (2000).

Digital Library

[19]

Zhao, Y., Deshpande, P.M., Naughton, J.F.: An array based algorithm for simultaneous multidimensional aggregate. In: ACM SIGMOD, pp. 159-170 (1997).

Digital Library

Cited By

Dehne FZaboli H(2012)Parallel Real-Time OLAP on Multi-core ProcessorsProceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)10.1109/CCGrid.2012.19(588-594)Online publication date: 13-May-2012
https://dl.acm.org/doi/10.1109/CCGrid.2012.19
Tsuchida TTsuji THiguchi K(2011)Implementing vertical splitting for large scale multidimensional datasets and its evaluationsProceedings of the 13th international conference on Data warehousing and knowledge discovery10.5555/2033616.2033637(208-223)Online publication date: 29-Aug-2011
https://dl.acm.org/doi/10.5555/2033616.2033637
Farooq FSarwar S(2010)Real-time data warehousing for business intelligenceProceedings of the 8th International Conference on Frontiers of Information Technology10.1145/1943628.1943666(1-7)Online publication date: 21-Dec-2010
https://dl.acm.org/doi/10.1145/1943628.1943666
Show More Cited By

Recommendations

Efficient incremental maintenance of data cubes
VLDB '06: Proceedings of the 32nd international conference on Very large data bases

The data cube provides users with aggregated results that are group-bys for all possible combinations of dimension attributes. When the number of dimension attributes is n, the data cube computes 2ⁿ group-bys, each of which is called a cuboid. A data ...
Incremental maintenance of object-oriented data warehouses

Incremental maintenance of data warehouses has attracted a lot of research attention for the past few years. Nevertheless, most of the previous work is confined to the relational setting. Recently, object-oriented data warehouses have been regarded as a ...
Data compression for incremental data cube maintenance
DASFAA'08: Proceedings of the 13th international conference on Database systems for advanced applications

We have proposed an incremental maintenance scheme of data cubes employing extendible multidimensional array model. Such an array enables incremental cube maintenance without relocating any data dumped at an earlier time, while computing the data cube ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

DASFAA'08: Proceedings of the 13th international conference on Database systems for advanced applications

March 2008

713 pages

ISBN:3540785671

Editors:
Jayant R. Haritsa
Indian Institute of Science, Supercomputer Education and Research Centre, Bangalore, India
,
Ramamohanarao Kotagiri
The University of Melbourne, Department of Computer Science and Software Engineering, Victoria, Australia
,
Vikram Pudi
International Institute of Information Technology, Hyderabad, India

Sponsors

Google Inc.
Tata Consultancy Services
Persistent Systems
Yahoo!
Great Software Laboratory

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 19 March 2008

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
3
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Dehne FZaboli H(2012)Parallel Real-Time OLAP on Multi-core ProcessorsProceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012)10.1109/CCGrid.2012.19(588-594)Online publication date: 13-May-2012
https://dl.acm.org/doi/10.1109/CCGrid.2012.19
Tsuchida TTsuji THiguchi K(2011)Implementing vertical splitting for large scale multidimensional datasets and its evaluationsProceedings of the 13th international conference on Data warehousing and knowledge discovery10.5555/2033616.2033637(208-223)Online publication date: 29-Aug-2011
https://dl.acm.org/doi/10.5555/2033616.2033637
Farooq FSarwar S(2010)Real-time data warehousing for business intelligenceProceedings of the 8th International Conference on Frontiers of Information Technology10.1145/1943628.1943666(1-7)Online publication date: 21-Dec-2010
https://dl.acm.org/doi/10.1145/1943628.1943666
Tsuji TJin DHiguchi K(2008)Data compression for incremental data cube maintenanceProceedings of the 13th international conference on Database systems for advanced applications10.5555/1802514.1802592(682-685)Online publication date: 19-Mar-2008
https://dl.acm.org/doi/10.5555/1802514.1802592

View Options

View options

Media

Figures

Other

Tables

View Table of Contents