Interesting evolutionary explanations about dropout

Source: Internet
Author: User

When training neural networks, use dropout technology to prevent over-fitting of the network. We don't talk about the details of this technique here, but we understand the interesting evolutionary interpretation of this technique. Nature's higher organisms have evolved sexual reproduction, which can be explained by the fact that mutated genes can spread throughout the race. But dropout that sexual reproduction is not just about making genes easier to spread, but that the strategy of sexual reproduction increases the robustness of genes. Why is it? Imagine that if an individual could reproduce, the individual could rely on the mutation and collaboration of each gene in his own genome to adapt to the environment, but when it was necessary to reproduce by mixing parents ' genes in order to produce offspring, collaboration within a single genome was broken by birds, Each gene not only tries to rely on itself to control various physiological functions independently, but also to be able to work with genes from other random individuals, both of which make each gene more robust. In the event of an environmental mutation, such as a space UV that destroys one-third of your genes, you can also survive to reproduce the next generation.

References: (Dropout:a simple-to-Prevent neural Networks from Overfitting.pdf) (improving neural Networks by preventing co- Adaptation of feature Detectors.pdf)

Interesting evolutionary explanations about dropout

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.