当前位置:网站首页>Network pruning (1)
Network pruning (1)
2022-08-02 14:19:00 【weixin_50862344】
Title of the paper: Learning Efficient Convolutional Networks through Network Slimming
Topic of this paper: Network Slimming
(1) Three meanings of pruning:
- reduce the model size;
- decrease the run-time memory footprint;
- lower the number of computing operations, without compromising accuracy.
1) Reduce model size; 2) Reduce runtime memory footprint; 3) Reduce the number of computational operations without compromising accuracy.
(2) Look directly at the conclusion:
It directly imposes sparsity-induced regularization on the scaling
factors in batch normalization layers, and unimportant channels can
thus be automatically identified during training and then pruned
Action object: BN layer (and unimportant channels)
Action mode: imposes sparsity-induced regularization on the scaling factorsp>
(3) What are Network Slimming and sparsity-induced regularization, scaling factors?????
First appearance of Network Slimming and sparsity-induced regularization, in this paragraph of the article.
The definition of Network Slimming is translated like this:
Our method applies L1 regularization to the scale factor in the batch normalization layer (BN), so it is easy to implement without introducing any changes to existing CNN architectures.Pushing the value of the BN scaling factor towards zero via L1 regularization allows us to identify unimportant channels (or neu-rons), since each scaling factor corresponds to a specific evolutionary channel (or neu-ron in a fully connected layer)yuan)
1) from the paragraph above (behind the blue line), 2) from the conclusion.
In other words:
1) Our approach imposes L1 regularlization on the scaling
factors in batch normalization (BN) layers
2) imposes sparsity-inducedregularization on the scaling factors
Then after reading this sentence, it is actually a picture
Then enter the Related Work paragraph
It mainly introduces the method of network structure compression, basically there is no need to watch hahahaha
Network slimming This paragraph
The papers sent by the Chinese understand the Chinese best!!!The bold type makes the point clear
I don't know if the translation is correct.Basically a penalty item
边栏推荐
猜你喜欢
随机推荐
配置zabbix自动发现和自动注册。
redis分布式锁和看门狗的实现
[ROS](01)创建ROS工作空间
php开源的客服系统_在线客服源码php
网络剪枝(1)
[ROS] The software package of the industrial computer does not compile
【Tensorflow】AttributeError: module 'keras.backend' has no attribute 'tf'
[ROS] The difference between roscd and cd
深度学习框架pytorch快速开发与实战chapter3
Flask框架深入二
[ROS](05)ROS通信 —— 节点,Nodes & Master
如何解决1045无法登录mysql服务器
EasyExcel 的使用
第四单元 路由层
[ROS] (04) Detailed explanation of package.xml
The bad policy has no long-term impact on the market, and the bull market will continue 2021-05-19
Sentinel源码(二)入口方法分析
deal!It's July 30th!
(ROS) (03) CMakeLists. TXT, rounding
paddleocr window10 first experience