Motivating challenges in Data Mining

1. scalability

If data mining algorithms are to handle these massive data sets, then they must be scalable.

2. high dimensionality

For some data analysis algorithms, the computational complexity increases rapidly as the dimensionality increases.

3. heterogeneous and complex data

Dealing with data with not the same type.

4. data ownership and distribution

Data is geographically distributed among resources belonging to multiple entities.

5. Non-traditional analysis

The traditional statistical approach is based on a hypothesize-and-test paradigm.

Current data analysis tasks often require the generation and Evaluation of thousands of hypotheses, and consequently, the development of some data mining techniques has been motivated by the desire to automate the process of hypothesis generation and evaluation.