2020-11-14-Alexnet

The first week Alex net

2020-06-15 00:00 to 2021-12-31 00:00

Job content ：

1. The answer is ：ImageNet The data set and ILSVRC What is the relationship between ？

ImageNet The data is ILSVRC The data set used in the competition

2. The answer is ：AlexNet Data enhancement during training , For location , What method is used to change a picture into 2048 A different picture （1 The pixel values are different , Also called different ）？

Training phase ：1. The picture is uniformly zoomed to 256*256   2. Cut out at random 224*224 Area   3. Randomly flip horizontally

Testing phase ：1. The picture is uniformly zoomed to 256*256   2. Cut out at random 224*224 Area   3. All are turned horizontally , Get... Together 10 Zhang 224*224 picture

3. The answer is ：AlexNet The use of Dropout, What should we pay attention to in the process of use ？

Data scale changes during training and testing

When testing , The neuron output value needs to be multiplied by p

4. The answer is ： After reading the paper , What inspired you ？

It can be used AlexNet Extract advanced features for image retrieval 、 Image clustering 、 Image coding

5. Code practice ： On the cat and dog dataset , Compare the two cases of using the pre training model and not using the pre training model , What is the difference between the training curve , Screenshot punch in .

 

6. written words ： The study notes and summary of this thesis

Key points ：ImageNet Lots of tagged data ; GPU High performance computing resources ;  Deep convolution neural network Rational algorithm model

Innovation points ：ReLu Speed up large-scale neural network training ：LRN Improve the generalization ability of large-scale networks ：Overlapping Pooling Improve indicators ; Random cropping, flipping and color disturbance increase data diversity ：Dropout Reduce over fitting

Inspiration ： Zoom the short side of the picture first