Article

Free access

Automating exploratory data analysis for efficient data mining

Authors:

Jonathan D. Becher,

Pavel Berkhin,

Edmund FreemanAuthors Info & Claims

KDD '00: Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining

Pages 424 - 429

https://doi.org/10.1145/347090.347179

Published: 01 August 2000 Publication History

PDF eReader

References

[1]

Asker, L., and Maclin, R. Feature Engineering and Classifier Selection: A Case Study in Venusian Vulcano Detection. Machine Learning: ICML'97, 3-11, Morgan Kaufmann, San Francisco, CA (1997).

Digital Library

Google Scholar

[2]

Breiman, L., Friedman, J.H., Olshen, R.A., Stone, C.J. Classification and Regression Trees. Wadsworth, Belmont, CA (1984).

Google Scholar

[3]

Cover, T.M., and Thomas J.A. Elements of Information Theory. John Wiley & Sons, Ney York, NY (1990).

Digital Library

Google Scholar

[4]

Derthick,M., Kolojejchick, J., and Roth, S.F. An Interactive Visualization Environment for Data Exploration. KDD-97, 2-9, AAAI Press, Menlo Park, CA (1997).

Google Scholar

[5]

Devaney, M., and Ram, A. Efficient Feature Selection in Conceptual Clustering. Machine Learning: ICML'97, 92-97, Morgan Kaufmann, San Francisco, CA (1997).

Digital Library

Google Scholar

[6]

Egan J.P. Signal Detection Theory and ROC Analysis, Series in Cognitition and Perception, Academic Press, 1975, New York, NY.

Google Scholar

[7]

Elkan C. Boosting and Naive Bayesian Learning. Technical Report No.CS97-557, UCSD (Sept. 1997).

Google Scholar

[8]

Fayyad U.M., and Irani K.B. Multi-interval discretization of continuous-valued attributes for classification learning. IJCAI' 93, 1022-1027 (1993).

Google Scholar

[9]

Friedman, N. Discretizing Continuous Attributes While Learning Bayesian Networks. Machine Learning: ICML'96, 157-165, Morgan Kaufmann, San Francisco, CA (1996).

Google Scholar

[10]

Guyon, I., Matic, N., and Vapnik, V. Discovering Information Patterns and Data Cleaning. KDD-94, 145-166, AAAI Press, Menlo Park, CA (1994).

Google Scholar

[11]

Haykin, S. Neural Networks. A comprehensive Foundation. Prentice Hall, Upper Saddle River, NJ (1999).

Digital Library

Google Scholar

[12]

Hertz, J., Krogh, A, and Palmer, R.G. Introduction to the theory of neural computations. Addison-Wesley, Reading, MA (1991).

Digital Library

Google Scholar

[13]

Huan Liu, and Setiono, R. A Probabilistic Approach to Feature Selection. A Filter Solution. Machine Learning: ICML'96, 319-327, Morgan Kaufmann, San Francisco, CA (1996).

Google Scholar

[14]

John, G.H., Kohavi, R., and Pfleger, K. Irrelevant Feature and Subset Selection. Machine Learning: ICML'94, 121- 129, Morgan Kaufmann, San Francisco, CA (1994).

Google Scholar

[15]

Jolliffe, I.T. Principle Component Analysis, Springer-Verlag, New York, N.Y. (1986).

Google Scholar

[16]

Kira, K., and Rendell, L. The Feature Selection Problem: Traditional Methods and New Algorithm. Tenth Natl. Conf. on Artificial Intelligence, 129-134, MIT Press (1992).

Google Scholar

[17]

Kohavi, R., and John, G.H. Wrappers for Feature Subset Selection. Artificial Intelligence, 97, 273-324 (1997).

Digital Library

Google Scholar

[18]

Koller, D., and Sahami, M. Toward Optimal Feature Selection. Machine Learning: ICML'96, 284-292, Morgan Kaufmann, San Francisco, CA (1996).

Google Scholar

[19]

Kullback, S., and Leibler, R.A. On information and sufficiency. Annals of Mathematical Statistics, 22, 76-86, (1951).

Crossref

Google Scholar

[20]

Ling C.X., Li C. Data Mining for Direct Marketing: Problems and Solutions, KDD-98, AAAI Press, Menlo Park, CA (1998).

Google Scholar

[21]

Mitchel, T.M. Machine Learning. McGraw-Hill, Boston, MA (1997).

Digital Library

Google Scholar

[22]

Ng, A.Y. On Feature Selection: Lerning with Exponentially many Irrelevant Features as Training Examples. Machine Learning: ICML'98, 404:412, Morgan Kaufmann, San Francisco, CA (1998).

Digital Library

Google Scholar

[23]

Otten, R.H.J.M., and van Ginneken, L.P.P.P, The Annealing Algorithm. Kluwer, Boston, MA (1989).

Digital Library

Google Scholar

[24]

Press, W.H., Teukolsky, S.A., Vettering, W.T., and Glannery, B.P. Numerical Recipes in C. 2nd ed., Cambridge Univ. Press, New York, NY (1992).

Digital Library

Google Scholar

[25]

Quinlan J.R. C4.5: Programs For Machine Learning. Morgan Kaufmann, San Mateo, CA (1993).

Digital Library

Google Scholar

[26]

Schurmann, J. Pattern Classification. A unified view of statistical and neural approaches. John Wiley & Sons, New York, NY (1996).

Digital Library

Google Scholar

[27]

Smyth, P., and Wolpert, D. Anytime Exploratory Data Analysis for Massive Data Sets. KDD-97, 54-60, AAAI Press, Menlo Park, CA (1997).

Google Scholar

[28]

Tukey, J.W., Exploratory Data Analysis. Addison-Wesley, Reading, MA (1977).

Google Scholar

Cited By

View all

AbouWard FSalem ASharaf N(2024)AUTOVI: Empowering Effective Tracing and Visualizations with AI2024 28th International Conference Information Visualisation (IV)10.1109/IV64223.2024.00057(294-297)Online publication date: 22-Jul-2024
https://doi.org/10.1109/IV64223.2024.00057
Muloor KSahu SDahal R(2022)Understanding of the Exploratory Graph Theoretical Approach for Data Analysis With Supervised and Unsupervised LearningHandbook of Research on Mathematical Modeling for Smart Healthcare Systems10.4018/978-1-6684-4580-8.ch016(306-324)Online publication date: 24-Jun-2022
https://doi.org/10.4018/978-1-6684-4580-8.ch016
Spruit MKais MMenger V(2021)Automated Business Goal Extraction from E-mail Repositories to Bootstrap Business UnderstandingFuture Internet10.3390/fi1310024313:10(243)Online publication date: 23-Sep-2021
https://doi.org/10.3390/fi13100243
Show More Cited By

Index Terms

Automating exploratory data analysis for efficient data mining
1. Computing methodologies
  1. Machine learning
    1. Learning paradigms
      1. Supervised learning
        Supervised learning by classification
    2. Machine learning approaches
      1. Classification and regression trees
2. Information systems
  1. Information systems applications
    1. Data mining

Recommendations

Automating Exploratory Data Analysis via Machine Learning: An Overview
SIGMOD '20: Proceedings of the 2020 ACM SIGMOD International Conference on Management of Data

Exploratory Data Analysis (EDA) is an important initial step for any knowledge discovery process, in which data scientists interactively explore unfamiliar datasets by issuing a sequence of analysis operations (e.g. filter, aggregation, and ...
Benchmarking Attribute Selection Techniques for Discrete Class Data Mining

Data engineering is generally considered to be a central issue in the development of data mining applications. The success of many learning schemes, in their attempts to construct models of data, hinges on the reliable identification of a small set of ...
An efficient algorithm for mining temporal high utility itemsets from data streams

Utility of an itemset is considered as the value of this itemset, and utility mining aims at identifying the itemsets with high utilities. The temporal high utility itemsets are the itemsets whose support is larger than a pre-specified threshold in ...

Comments

Information & Contributors

Information

Published In

KDD '00: Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining

August 2000

537 pages

ISBN:1581132336

DOI:10.1145/347090

Chairmen:
Raghu Ramakrishnan
Univ. of Wisconsin
,
Sal Stolfo
Columbia Univ., New York, NY
,
Roberto Bayardo
IBM Almaden Research Center, San Jose, CA
,
Ismail Parsa
Epsilon

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 August 2000

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

KDD00

Sponsor:

KDD00: The Second Annual International Conference on Knowledge Discovery in Data

August 20 - 23, 2000

Massachusetts, Boston, USA

Acceptance Rates

Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

Upcoming Conference

KDD '25

Sponsor:
sigkdd
sigkdd

The 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining

August 3 - 7, 2025

Toronto , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
1,399
Total Downloads

Downloads (Last 12 months)145
Downloads (Last 6 weeks)21

Reflects downloads up to 05 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

AbouWard FSalem ASharaf N(2024)AUTOVI: Empowering Effective Tracing and Visualizations with AI2024 28th International Conference Information Visualisation (IV)10.1109/IV64223.2024.00057(294-297)Online publication date: 22-Jul-2024
https://doi.org/10.1109/IV64223.2024.00057
Muloor KSahu SDahal R(2022)Understanding of the Exploratory Graph Theoretical Approach for Data Analysis With Supervised and Unsupervised LearningHandbook of Research on Mathematical Modeling for Smart Healthcare Systems10.4018/978-1-6684-4580-8.ch016(306-324)Online publication date: 24-Jun-2022
https://doi.org/10.4018/978-1-6684-4580-8.ch016
Spruit MKais MMenger V(2021)Automated Business Goal Extraction from E-mail Repositories to Bootstrap Business UnderstandingFuture Internet10.3390/fi1310024313:10(243)Online publication date: 23-Sep-2021
https://doi.org/10.3390/fi13100243
Pastorino JBiswas A(2020)Hey ML, what can you do for me?2020 IEEE Third International Conference on Artificial Intelligence and Knowledge Engineering (AIKE)10.1109/AIKE48582.2020.00023(116-119)Online publication date: Dec-2020
https://doi.org/10.1109/AIKE48582.2020.00023
Ansari MAhmad AKhan SBhushan GMainuddin (2019)Spatiotemporal clustering: a reviewArtificial Intelligence Review10.1007/s10462-019-09736-1Online publication date: 15-Jul-2019
https://doi.org/10.1007/s10462-019-09736-1
Thankachan K(2017)Automating anomaly detection for exploratory data analytics2017 International Conference on Inventive Computing and Informatics (ICICI)10.1109/ICICI.2017.8365228(711-715)Online publication date: Nov-2017
https://doi.org/10.1109/ICICI.2017.8365228
Ilies IWilhelm A(2010)Projection-Based Partitioning for Large, High-Dimensional DatasetsJournal of Computational and Graphical Statistics10.1198/jcgs.2010.0803819:2(474-492)Online publication date: Jan-2010
https://doi.org/10.1198/jcgs.2010.08038
Bradley P(2003)Data mining as an automated serviceProceedings of the 7th Pacific-Asia conference on Advances in knowledge discovery and data mining10.5555/1760894.1760896(1-13)Online publication date: 30-Apr-2003
https://dl.acm.org/doi/10.5555/1760894.1760896
Bradley P(2003)Data Mining as an Automated ServiceAdvances in Knowledge Discovery and Data Mining10.1007/3-540-36175-8_1(1-13)Online publication date: 30-Apr-2003
https://doi.org/10.1007/3-540-36175-8_1
Micci-Barreca D(2001)A preprocessing scheme for high-cardinality categorical attributes in classification and prediction problemsACM SIGKDD Explorations Newsletter10.1145/507533.5075383:1(27-32)Online publication date: 1-Jul-2001
https://dl.acm.org/doi/10.1145/507533.507538

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Automating Exploratory Data Analysis via Machine Learning: An Overview

Benchmarking Attribute Selection Techniques for Discrete Class Data Mining

An efficient algorithm for mining temporal high utility itemsets from data streams