What is the bottleneck and weakness of AlphaGo?

Source: Internet
Author: User

Is self-play a bottleneck in theory for AlphaGo to improve? My Perspective is not! The real problem with AlphaGo (and any other AI and human) are the state space of Go are much larger than the state space of Its neural network, therefore no matter how we train it, it still suffers from the underfitting problem. Which means there is always a problem with the value network and Policy network that, when some cases was trained very wel L, other cases pops up.

But in terms of supervised learning vs unsupervised learning, they-differ in training set, which means they make A Lphago ' s neural network bias to a certain style and handles certain cases very well. Unsupervised learning can provide all the information so supervised learning can provide, imagine the board is 9*9, Unsu Pervised learning is absolutely enough to provide a good training set. So, unsupervised learning are not really a bottleneck in theory, but in practice supervised learning makes AlphaGo bias to A certain style, and has a better chance to win a certain opponent. When it neural network gets larger to being able to accommodates more states, the value of supervised learning is also D ecreased.

Because of the underfitting problem, the value network may get wrong on who's winning the game on some states which may lo OK simple to human. This is what AlphaGo use MCTS to rollout for many steps for validation, if playing down some steps, the game I s still in favor of AlphaGo, the original state is considered truly good. So, AlphaGo are really a mixture of "Intuition + Logic", this is very similar to human.

This design makes it very hard-to-catch AlphaGo ' s weakness, but it does exists. Based on the analysis above, the weakness of AlphaGo are clear to me now:its value network gets wrong on not only one stat E, but also many steps following the state. Although the probability is very low, but it does happened in Game 4. Brilliant Lee sedol!

What is the bottleneck and weakness of AlphaGo?

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.