best neural network book

structure (1). Intuition of CNNIn deep learning book, author gives a very interesting insight. He consider convolution and pooling as a infinite strong prior distribution. The distribution indicates, all hidden units share the same weight, derived from certain amount of the input and has Parallel invariant feature.Under Bayesian statistics, prior distribuion is a subjective preference of the model based on experience. and the stronger the prior distr

4 activation function One of the things to be concerned about when building a neural network is what kind of activation function should be used in each separate layer. In logistic regression, the sigmoid function is always used as the activation function, and there are some better choices. The expression for the tanh function (hyperbolic Tangent function, hyperbolic tangent) is: The function image is: Th

this:According to our experience, if the alphabet can be moved to the center of the field of view, the difficulty of recognition will be reduced a lot, in favor of improving the recognition rate.In this case, if we can change the image to the standard size, we can increase the corresponding recognition rate.For objects of real knowledge, from different angles, there will be different manifestations, even for the letter recognition, the letter can appear rotating:If the image can be rotated, the

Introduction to neural network programming (2): What are we writing during socket writing? Http://www.52im.net/thread-1732-1-1.html 1. IntroductionThis article is followed by the first article titled Neural Network Programming (I): Follow the animation to learn TCP three-way handshakes and four waves, and cont

regression model), the final result is reflected in the data is a straight line or a super plane, But if the data is not linear, the performance of these models will become worse. In view of this problem, there are many algorithms for classifying non-linear data, and neural network is one of the earliest. for a logistic regression model, it can be represented as shown:Where Xi is the individual component o

the fifth chapter uses the SVM and the neural network the license plate recognitionTags: license plate recognition 2014-03-13 21:23 1115 people Read reviews (0) Favorite report Category: Images (42) Directory (?) [+] "Original: http://blog.csdn.net/raby_gyl/article/details/11617875" Title: "Mastering OpenCV with practical computer Vision Projects" because added a * number, display garbled, do not know how

BP algorithm:　　1. is a supervised learning algorithm, often used to train multilayer perceptron.2. The excitation function required for each artificial neuron (i.e. node) must be micro-(Excitation function: the function relationship between the input and output of a single neuron is called the excitation function.) ）(If the excitation function is not used, each layer in the neural network is simply a linear

non-XOR (the same as 1, the difference is 0), all the output of our training model will be wrong, the model is not linear!2. Neural Network Introduction:We can construct the following models:(where a represents logic with, B is logical or inverse, C is logical OR)The above model is a simple neural network, we have con

Cyclic neural network--Realization Gitbook Reading AddressKnowledge of reading address gradients disappearing and gradient explosions Network recall: In the circular neural network-Introduction, the circular neural

LSTM (long-short term Memory, LSTM) is a time recurrent neural network that was first published in 1997. Due to its unique design structure, LSTM is suitable for handling and predicting important events with very long intervals and delays in time series. Based on the introduction of deep learning three Daniel, Lstm network has been proved to be more effective tha

Based on the traditional polynomial regression, neural network is inspired by the "activation" phenomenon of the biological neural network, and the machine learning model is built up by the activation function.In the field of image processing, because of the large amount of data, the problem is that the number of

Introduction to recurrent neural networks (RNN, recurrent neural Networks) This post was reproduced from: http://blog.csdn.net/heyongluoyao8/article/details/48636251 The cyclic neural network (recurrent neural Networks,rnns) has been successfully and widely used in many nat

Although the research and application of neural network has been very successful, but in the development and design of the network, there is still no perfect theory to guide the application of the main design method is to fully understand the problem to be solved on the basis of a combination of experience and temptation, through a number of improved test, finall

Deep learning "engine" contention: GPU acceleration or a proprietary neural network chip?Deep Learning (Deepin learning) has swept the world in the past two years, the driving role of big data and high-performance computing platform is very important, can be described as deep learning "fuel" and "engine", GPU is engine engine, basic all deep learning computing platform with GPU acceleration. At the same tim

BP (Back Propagation) network is a multi-layer feed-forward Network trained by the error inverse propagation algorithm, which was proposed by a team of scientists led by Rumelhart and mccelland in 1986, it is one of the most widely used neural networks. The BP network can learn and store a large number of input-output

The BP (back propagation) network was presented by a team of scientists, led by Rumelhart and McCelland in 1986, and is a multi-layered feedforward network trained by error inverse propagation algorithm, which is one of the most widely used neural network models. The BP network