当前位置:网站首页>mmdetection 学习率与batch_size关系
mmdetection 学习率与batch_size关系
2022-07-03 14:43:00 【swust_fang】
一般mmdetection复现的文章学习率都在对应config文件下,是0.01或者0.02。
如果自己要复现论文,但是gpu数量不足,比如只有一块gpu,如何设置学习率呢
但是原论文学习率是0.01,samples_per_gpu=2,gpu_num = 8
原论文 batch_size = samples_per_gpu * gpu_num =16
那么 batch_size*LR 这个值是不变的
如果你只有一块gpu,samples_per_gpu=8,batch_size=8,你的新的学习率lr = 0.005
如果你有两块gpu,sample_per_gpu=2,batch_size=4,那么新学习率lr=0.025
如果你有4块gpu,sample_per_gpu=4,batch_size=16,学习率不变,lr=0.01
边栏推荐
- Simulation of LS -al command in C language
- Zzuli:1044 failure rate
- The picture quality has been improved! LR enhancement details_ Lightroom turns on AI photo detail enhancement: picture clarity increases by 30%
- Analysis of gene family characteristics - chromosome location analysis
- C language to realize mine sweeping
- Bucket sorting in C language
- ShowMeBug入驻腾讯会议,开启专业级技术面试时代
- Tonybot Humanoïde Robot Infrared Remote play 0630
- Qt development - scrolling digital selector commonly used in embedded system
- Zzuli:1041 sum of sequence 2
猜你喜欢
Tiantu investment sprint Hong Kong stocks: asset management scale of 24.9 billion, invested in xiaohongshu and Naixue
Adc128s022 ADC Verilog design and Implementation
Solve the problem that PR cannot be installed on win10 system. Pr2021 version -premiere Pro 2021 official Chinese version installation tutorial
Tonybot humanoid robot starts for the first time 0630
Accelerating strategy learning using parallel differentiable simulation
On MEM series functions of C language
Puzzle (016.4) domino effect
Zhonggan micro sprint technology innovation board: annual revenue of 240million, net loss of 17.82 million, proposed to raise 600million
NFT new opportunity, multimedia NFT aggregation platform okaleido will be launched soon
Sword finger offer 28 Symmetric binary tree
随机推荐
Zzuli:1048 factorial table
retrofit
Tonybot humanoid robot checks the port and corresponds to port 0701
puzzle(016.3)千丝万缕
Tonybot humanoid robot infrared remote control play 0630
X86 assembly language - Notes from real mode to protected mode
Write a 2-minute countdown.
Bibit pharmaceutical rushed to the scientific innovation board: annual revenue of 970000, loss of 137million, proposed to raise 2billion
Detailed explanation of four modes of distributed transaction (Seata)
Find books ()
C language STR function
Dllexport et dllimport
Zhonggan micro sprint technology innovation board: annual revenue of 240million, net loss of 17.82 million, proposed to raise 600million
How Facebook moves instagram from AWS to its own server
DDK for XP
US stock listing of polar: how can the delivery of 55000 units support the valuation of more than 20billion US dollars
Zhejiang University Edition "C language programming (4th Edition)" topic set reference ideas set
Zzuli:1043 max
My QT learning path -- how qdatetimeedit is empty
tonybot 人形机器人 查看端口并对应端口 0701