LSTM Study and Summary 1

The long short-term memory network lstm (long, shorter) is not a complete model in itself, but is mainly an improvement on the RNN hidden layer. Therefore, the RNN network is the RNN network that uses the LSTM unit. The lstm is ideal for dealing with issues that are highly correlated with time series, such as machine translation, dialog generation, encoding and decoding, and graphics conversion.

Description: Word2vec (cbow,skip-gram), Gru,word embedding (Word vector), MDP (Markov decision Process), deep reinforcement learning,dqn, etc.

Reference documents:

[1] lstm implementation of the explanation: http://www.csdn.net/article/2015-09-14/2825693

[2] Char-rnn:https://github.com/karpathy/char-rnn

[3] In layman lstm neural network: http://www.csdn.net/article/2015-06-05/2824880

[4] Learning to read with recurrent neural networks:http://blog.terminal.com/ recurrent-neural-networks-deep-net-optimization-lstm/

[5] Understanding LSTM Network: http://www.jianshu.com/p/9dc9f41f0b29/

[6] The derivation of the BP algorithm for Deep learning (additional rnn,lstm deduction description): http://blog.csdn.net/zhuanshenweiliu/article/details/42267993

[7] LSTM Networks for sentiment analysis:http://deeplearning.net/tutorial/lstm.html

[8] How to evaluate the recent comparison of fire lstm? : http://www.zhihu.com/question/27017697

[9] Long short-term memory:tutorial on LSTM recurrent networks:http://people.idsia.ch/~juergen/lstm/

[Ten] Caffe-lstm:https://github.com/junhyukoh/caffe-lstm

[One] lstm introduction and mathematical deduction: http://blog.csdn.net/a635661820/article/details/45390671

Lstm and sentiment analysis: http://www.weixingon.com/s/lstm+%E6%83%85%E6%84%9F%E5%88%86%E6%9E%90

[13] What are the lstm (Long short term Memory) and RNN (recurrent) network tutorials? : http://www.zhihu.com/question/29411132?utm_source=top.caibaojian.com/47897

[14] Deep learning materials Daquan: http://www.cnblogs.com/charlotte77/p/5485438.html

[15] Recent internet-swept deep dream AI image recognition software: http://www.ltaaa.com/bbs/thread-364424-1-1.html

[16] Deep learning: A new engine driving the development of the NLP field: http://www.iteye.com/news/31261

[17] Inventory of 8 Most inspiring deep learning applications: http://synchuman.baijia.baidu.com/article/542746

[DQN] from getting started to giving up (DQN and reinforcement learning): https://zhuanlan.zhihu.com/p/21262246

[19] Depth Enhancement Learning DRL column: http://blog.csdn.net/column/details/deeprl.html

LSTM Study and Summary 1