how to train convolutional neural network

structure (1). Intuition of CNNIn deep learning book, author gives a very interesting insight. He consider convolution and pooling as a infinite strong prior distribution. The distribution indicates, all hidden units share the same weight, derived from certain amount of the input and has Parallel invariant feature.Under Bayesian statistics, prior distribuion is a subjective preference of the model based on experience. and the stronger the prior distribution is, the higher impact it'll has on th

It took a week to learn about neural networks after soy sauce in the Knowledge Engineering Center. The teacher arranged a question and asked me to try it. I did a little simple. I conducted several groups of tests and wrote a summary report. I posted it here. After more than a week of experimentation, I have a simple understanding of this issue. The following is my thoughts on this issue. In the last two days, I suddenly felt that the problem was much

implication of this is that the statistical characteristics of the part of the image are the same as the rest. This also means that the features we learn in this section can also be used in other parts, so we can use the same learning features for all the locations on this image. More intuitively, when a small piece is randomly selected from a large image, such as 8x8 as a sample, and some features are learned from this small sample, we can apply the feature learned from this 8x8 sample as a de

The article does not write clearly please forgive QaqIn this article we will make a very simple image classifier with the CIFAR-10 data set. The CIFAR-10 dataset contains 60,000 images. In this dataset, there are 10 different categories, with 6,000 images in each category. The size of each image is x 32 pixels. While such a small size often poses difficulties in identifying the right category for humans, it is actually a simplification of the computer model and reduces the computational complexi

BP algorithm:　　1. is a supervised learning algorithm, often used to train multilayer perceptron.2. The excitation function required for each artificial neuron (i.e. node) must be micro-(Excitation function: the function relationship between the input and output of a single neuron is called the excitation function.) ）(If the excitation function is not used, each layer in the neural

Deep Learning Neural Network pure C language basic Edition Today, Deep Learning has become a field of fire, and the performance of Deep Learning Neural Networks (DNN) in the field of computer vision is remarkable. Of course, convolutional neural networks are used in engineer

Cyclic neural network--Realization Gitbook Reading AddressKnowledge of reading address gradients disappearing and gradient explosions Network recall: In the circular neural network-Introduction, the circular neural