当前位置:网站首页>Network pruning (1)
Network pruning (1)
2022-08-02 14:19:00 【weixin_50862344】
Title of the paper: Learning Efficient Convolutional Networks through Network Slimming
Topic of this paper: Network Slimming
(1) Three meanings of pruning:
- reduce the model size;
- decrease the run-time memory footprint;
- lower the number of computing operations, without compromising accuracy.
1) Reduce model size; 2) Reduce runtime memory footprint; 3) Reduce the number of computational operations without compromising accuracy.
(2) Look directly at the conclusion:
It directly imposes sparsity-induced regularization on the scaling
factors in batch normalization layers, and unimportant channels can
thus be automatically identified during training and then pruned
Action object: BN layer (and unimportant channels)
Action mode: imposes sparsity-induced regularization on the scaling factorsp>
(3) What are Network Slimming and sparsity-induced regularization, scaling factors?????
First appearance of Network Slimming and sparsity-induced regularization, in this paragraph of the article.
The definition of Network Slimming is translated like this:
Our method applies L1 regularization to the scale factor in the batch normalization layer (BN), so it is easy to implement without introducing any changes to existing CNN architectures.Pushing the value of the BN scaling factor towards zero via L1 regularization allows us to identify unimportant channels (or neu-rons), since each scaling factor corresponds to a specific evolutionary channel (or neu-ron in a fully connected layer)yuan)
1) from the paragraph above (behind the blue line), 2) from the conclusion.
In other words:
1) Our approach imposes L1 regularlization on the scaling
factors in batch normalization (BN) layers
2) imposes sparsity-inducedregularization on the scaling factors

Then after reading this sentence, it is actually a picture
Then enter the Related Work paragraph
It mainly introduces the method of network structure compression, basically there is no need to watch hahahaha
Network slimming This paragraph
The papers sent by the Chinese understand the Chinese best!!!The bold type makes the point clear
I don't know if the translation is correct.Basically a penalty item
边栏推荐
猜你喜欢
随机推荐
RowBounds[通俗易懂]
目标检测场景SSD-Mobilenetv1-FPN
idea社区版下载安装教程_安装天然气管道的流程
Interview | with questions to learn, Apache DolphinScheduler Wang Fuzheng
关于密码加密的一点思路
未来的金融服务永远不会停歇,牛市仍将继续 2021-05-28
Configure zabbix auto-discovery and auto-registration.
第四单元 路由层
深度学习框架pytorch快速开发与实战chapter3
You can't accept 60% slump, there is no eligible for gain of 6000% in 2021-05-27
About the development forecast of the market outlook?2021-05-23
window10下半自动标注
8581 线性链表逆置
The world's largest Apache open source foundation is how it works?
你接受不了60%的暴跌,就没有资格获得6000%的涨幅 2021-05-27
Sentinel源码(一)SentinelResourceAspect
Audio processing: floating point data stream to PCM file
第十四单元 视图集及路由
replay视频播放器_怎么让手机音乐跟视频一起放
deal!It's July 30th!
![[ROS] The difference between roscd and cd](/img/a8/a1347568170821e8f186091b93e52a.png)




CMakeLists.txt详解](/img/34/577c729f06748f625ca0c223496d48.png)


