当前位置:网站首页>mmdetection 学习率与batch_size关系
mmdetection 学习率与batch_size关系
2022-07-03 14:43:00 【swust_fang】
一般mmdetection复现的文章学习率都在对应config文件下,是0.01或者0.02。
如果自己要复现论文,但是gpu数量不足,比如只有一块gpu,如何设置学习率呢
但是原论文学习率是0.01,samples_per_gpu=2,gpu_num = 8
原论文 batch_size = samples_per_gpu * gpu_num =16
那么 batch_size*LR 这个值是不变的
如果你只有一块gpu,samples_per_gpu=8,batch_size=8,你的新的学习率lr = 0.005
如果你有两块gpu,sample_per_gpu=2,batch_size=4,那么新学习率lr=0.025
如果你有4块gpu,sample_per_gpu=4,batch_size=16,学习率不变,lr=0.01
边栏推荐
- 提高效率 Or 增加成本,开发人员应如何理解结对编程?
- SSH access control, blocking the IP when logging in repeatedly to prevent brute force cracking
- Fundamentals of PHP deserialization
- Tonybot Humanoïde Robot Infrared Remote play 0630
- Awvs batch operation script
- Zzuli:1048 factorial table
- Tiantu investment sprint Hong Kong stocks: asset management scale of 24.9 billion, invested in xiaohongshu and Naixue
- Stop asking yourself if you are suitable for software testing
- 分布式事务(Seata) 四大模式详解
- String substitution
猜你喜欢
C language fcntl function
Dllexport and dllimport
retrofit
dllexport和dllimport
Luogu p5018 [noip2018 popularization group] symmetric binary tree problem solution
Talking about part of data storage in C language
Why is this error reported when modifying records in the database
retrofit
pyQt界面制作(登录+跳转页面)
Tonybot humanoid robot checks the port and corresponds to port 0701
随机推荐
Zzuli:1041 sum of sequence 2
Why is this error reported when modifying records in the database
retrofit
Zhejiang University Edition "C language programming (4th Edition)" topic set reference ideas set
NFT new opportunity, multimedia NFT aggregation platform okaleido will be launched soon
C language memory function
洛谷P5194 [USACO05DEC]Scales S 题解
Puzzle (016.4) domino effect
Detailed explanation of four modes of distributed transaction (Seata)
Simulation of LS -al command in C language
Thread. Sleep and timeunit SECONDS. The difference between sleep
Sword finger offer 28 Symmetric binary tree
Solve the problem that PR cannot be installed on win10 system. Pr2021 version -premiere Pro 2021 official Chinese version installation tutorial
Address book sorting
US stock listing of polar: how can the delivery of 55000 units support the valuation of more than 20billion US dollars
Awvs batch operation script
Luogu p3065 [usaco12dec]first! G problem solution
Solr series of full-text search engines - basic principles of full-text search
Amazon, express, lazada, shopee, eBay, wish, Wal Mart, Alibaba international, meikeduo and other cross-border e-commerce platforms evaluate how Ziyang account can seize traffic by using products in th
Zzuli:1053 sine function