当前位置:网站首页>mmdetection 学习率与batch_size关系
mmdetection 学习率与batch_size关系
2022-07-03 14:43:00 【swust_fang】
一般mmdetection复现的文章学习率都在对应config文件下,是0.01或者0.02。
如果自己要复现论文,但是gpu数量不足,比如只有一块gpu,如何设置学习率呢
但是原论文学习率是0.01,samples_per_gpu=2,gpu_num = 8
原论文 batch_size = samples_per_gpu * gpu_num =16
那么 batch_size*LR 这个值是不变的
如果你只有一块gpu,samples_per_gpu=8,batch_size=8,你的新的学习率lr = 0.005
如果你有两块gpu,sample_per_gpu=2,batch_size=4,那么新学习率lr=0.025
如果你有4块gpu,sample_per_gpu=4,batch_size=16,学习率不变,lr=0.01
边栏推荐
- Rasterization: a practical implementation (2)
- Pyqt interface production (login + jump page)
- 天谋科技 Timecho 完成近亿元人民币天使轮融资,打造工业物联网原生时序数据库
- 556. The next larger element III
- Awvs batch operation script
- Bibit pharmaceutical rushed to the scientific innovation board: annual revenue of 970000, loss of 137million, proposed to raise 2billion
- 【7.3】146. LRU缓存机制
- Solr series of full-text search engines - basic principles of full-text search
- C language fcntl function
- Zzuli:1058 solving inequalities
猜你喜欢

My QT learning path -- how qdatetimeedit is empty

NPM install is stuck with various strange errors of node NPY

提高效率 Or 增加成本,开发人员应如何理解结对编程?

The latest M1 dedicated Au update Adobe audit CC 2021 Chinese direct installation version has solved the problems of M1 installation without flash back!

tonybot 人形机器人 查看端口并对应端口 0701
![洛谷P5018 [NOIP2018 普及组] 对称二叉树 题解](/img/89/da1a3a38e02671628f385de0f30369.png)
洛谷P5018 [NOIP2018 普及组] 对称二叉树 题解

Timecho of Tianmou technology completed an angel round financing of nearly 100 million yuan to create a native timing database of the industrial Internet of things

Puzzle (016.4) domino effect

Sub-GHz无线解决方案Z-Wave 800 系列ZG23 soc和ZGM230S模块

Doris学习笔记之数据表的创建
随机推荐
Use of form text box (I) select text
7-10 stack of hats (25 points) (C language solution)
C language to realize mine sweeping
Four data flows and cases of grpc
NOI OPENJUDGE 1.5(23)
Timecho of Tianmou technology completed an angel round financing of nearly 100 million yuan to create a native timing database of the industrial Internet of things
Zzuli:1052 sum of sequence 4
7-1 positive integer a+b (15 points)
NFT new opportunity, multimedia NFT aggregation platform okaleido will be launched soon
Implement Gobang with C language
动态获取权限
Understand the application scenario and implementation mechanism of differential segment
Fundamentals of PHP deserialization
Sendmail can't send mail and it's too slow to send. Solve it
Add ZABBIX calculation type itemcalculated items
Zzuli:1058 solving inequalities
[combinatorics] permutation and combination (set combination, one-to-one correspondence model analysis example)
Talking about part of data storage in C language
Mongodb index
7-3 rental (20 points)