Machine learning Training Set traing, validation, test data set

Source: Internet
Author: User

Normally to perform supervised learning you need both types of data sets:

In one dataset (your ' gold standard ') you had the input data together with correct/expected output, this dataset is usual Ly duly prepared either by humans or by collecting some the data in semi-automated. But it's important, and the expected output for every data row here, because you need for supervised learning.

The data is going to apply your model to. In many cases this is the data where you're interested for the output of your model and thus you don ' t has any ' expected "Output here yet.

While performing machine learning your do the following:training phase:you present your data from your ' gold standard "And train your model, by pairing the input with expected output. Validation/test phase:in order to estimate how well your model have been trained (that's dependent upon the size of your Data, the value of would like to predict, input etc) and to estimate model properties (mean error for numeric predictors, Classification errors for classifiers, recall and precision for ir-models etc.) Application Phase:now You apply your freshly-developed model to the Real-world data and get the results. Since you normally don ' t has any reference value in this type of data (otherwise, why would do need your model?), you CA N only speculate about the quality of your model output using the results of your validation phase.

The validation phase is often split into a parts:in the first part of you just look at your models and select the best per Forming approach using the validation data (=validation) then you estimate the accuracy of the selected approach (=test).

Hence the separation to 50/25/25.

If you don't need to choose an appropriate model from several rivaling approaches, you can just re-partition your Set that you basically has only training set and test set, without performing the validation of your trained model. I personally partition them 70/30 then.

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.