当前位置:网站首页>From repvgg to mobileone, including mobileone code
From repvgg to mobileone, including mobileone code
2022-07-04 21:52:00 【Roaring Ajie】
The idea of re parameterization is essentially to use the additivity of linear models . In industry, it is conv and bn Layer fusion is applied . In recent years, there have been re-parameter The job of .RepVGG It is a good application .
VGG It is a straight cylinder model , Because no skip connnection, Lead to deeper training vgg There will be degradation of the model . However, such as resnet etc. ,skip connnect It increases the running time for the end-to-end equipment , There is a lot of consumption in data access .
therefore RepVGG, Integrate the idea of heavy parameters , During the training , by vgg Introduced skip connection, During the test skip connection Merge with the main branch , Get one convbnrelu block, Then it becomes a straight cylinder model .
But it's different from resnet,RepVgg In order to ensure the additive principle of linear model , In two relu Between , Use residual Branch . Because any linear layer between nonlinear layers , Can be merged .
About how to integrate , You can see it in the reference link , It's very detailed
and MobileOne It is in RepVGG On the basis of , Realize that the straight cylinder model can bring a good acceleration to the end model . So it was decided that RepVgg Transformed into a lightweight model , Convolute depth separation , Use some well-designed training strategies , Make the straight tube model on the light-weight model , On a par mobilenet And other well-known lightweight models , And it is better in running speed .
I reappeared mobileone Of s0 edition , The effect is almost the same as that of the paper , Interest can be found in my github see
MobileOne code
Reference resources
边栏推荐
- QT - double buffer plot
- Billions of citizens' information has been leaked! Is there any "rescue" for data security on the public cloud?
- 什么是商业智能(BI),就看这篇文章足够了
- [C language] deep understanding of symbols
- Golang面试整理 三 简历如何书写
- EhLib 数据库记录的下拉选择
- 案例分享|金融业数据运营运维一体化建设
- 开户哪家券商比较好?网上开户安全吗
- At the right time, the Guangzhou station of the city chain science and Technology Strategy Summit was successfully held
- 置信区间的画法
猜你喜欢
【C語言】符號的深度理解
[weekly translation go] how to code in go series articles are online!!
TCP三次握手,四次挥手,你真的了解吗?
Super detailed tutorial, an introduction to istio Architecture Principle and practical application
Daily question -leetcode1200- minimum absolute difference - array - sort
开源之夏专访|Apache IoTDB社区 新晋Committer谢其骏
[ 每周译Go ] 《How to Code in Go》系列文章上线了!!
Sorting and sharing of selected papers, systems and applications related to the most comprehensive mixed expert (MOE) model in history
解读创客教育中的各类智能化组织发展
Shutter textfield example
随机推荐
Jerry's ad series MIDI function description [chapter]
Three or two things about the actual combat of OMS system
flink1.13 sql基础语法(一)DDL、DML
Go language loop statement (3 in Lesson 10)
MP3是如何诞生的?
Jerry's ad series MIDI function description [chapter]
gtest从一无所知到熟练运用(1)gtest安装
挖财学院股票开户安全吗?开户只能在挖财开户嘛?
[wechat applet] collaborative work and release
Enlightenment of maker thinking in Higher Education
开源之夏专访|Apache IoTDB社区 新晋Committer谢其骏
GTEST from ignorance to skillful use (1) GTEST installation
Flutter TextField示例
QT—双缓冲绘图
Redis 排查大 key 的3种方法,优化必备
并列图的画法,多排多列
TCP三次握手,四次挥手,你真的了解吗?
Delphi SOAP WebService 服务器端多个 SoapDataModule 实现相同的接口方法,接口继承
Rotary transformer string judgment
哈希表(Hash Tabel)