Differences between SVM and LR

Source: Internet
Author: User
Tags svm
Similarities between LR and SVM
  1. Both LR and SVM are classification algorithms.
  2. If kernel functions are not considered, LR and SVM are linear classification algorithms, that is, their classification decision planes are linear.
  3. LR and SVM are both supervised learning algorithms.
  4. Both LR and SVM are discriminative models.
Differences
  1. Different loss functions
  2. SVM only considers the points near the local boundary line, while logistic regression considers global (the confirmation of the distant point also works ).
  3. In solving non-linear Problems, SVM uses the kernel function mechanism, while LR usually does not use the kernel function method.When calculating the decision plane, only a few samples representing the support vector are involved in the SVM algorithm, that is, only a few samples need to be involved in the kernel calculation (that is, the coefficients of the kernal machine solution are sparse ). However, in the LR algorithm, each sample point must be involved in the calculation process of the Decision surface. That is to say, if we also use the kernel function principle in LR, then each sample point must be involved in the kernel calculation, the computing complexity is quite high. Therefore, in specific applications, LR seldom uses the kernel function mechanism.
  4. Linear SVM depends on the distance measurement expressed by data. Therefore, normalization is required for data, and LR is not affected.
  5. The loss function of SVM comes with regular expressions.

Differences between SVM and LR

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.