Mathematical Principles in word2vec (4) Hierarchical softmax-based model

Source: Internet
Author: User

      
Word2vec is a toolkit launched by Google in 2013 by open source for obtaining word vector. It is simple and efficient, so it has aroused the attention of many people. Tomas Mikolov, the author of word2vec, did not talk about too many algorithm details in two related papers [3, 4], thus increasing the mystery of this toolkit to a certain extent. Some people who couldn't help but choose to take a look at the source code through anatomy. Out of curiosity, I became one of them. After reading the code, I felt that I had gained a lot. I wrote it into my documents and gave it to anyone who needed it.


Related Links


(1) contents and Preface

(2) Prerequisites

(3) Background Knowledge

(4) Hierarchical softmax-based model

(5) Negative sampling-based model

(6) several source code details







Author: peghoty

Source: http://blog.csdn.net/itplus/article/details/37969979

You are welcome to repost/share the article, but be sure to declare the source of the article.

Mathematical Principles in word2vec (4) Hierarchical softmax-based model

Contact Us

The content source of this page is from Internet, which doesn't represent Alibaba Cloud's opinion; products and services mentioned on that page don't have any relationship with Alibaba Cloud. If the content of the page makes you feel confusing, please write us an email, we will handle the problem within 5 days after receiving your email.

If you find any instances of plagiarism from the community, please send an email to: info-contact@alibabacloud.com and provide relevant evidence. A staff member will contact you within 5 working days.

A Free Trial That Lets You Build Big!

Start building with 50+ products and up to 12 months usage for Elastic Compute Service

  • Sales Support

    1 on 1 presale consultation

  • After-Sales Support

    24/7 Technical Support 6 Free Tickets per Quarter Faster Response

  • Alibaba Cloud offers highly flexible support services tailored to meet your exact needs.