当前位置:网站首页>pytorch Default process group is not initialized
pytorch Default process group is not initialized
2022-06-27 06:32:00 【AI视觉网奇】
报错:Default process group is not initialized
报错代码,yolov5训练时不报错, 参数配置错了,
with torch_distributed_zero_first(rank):
dataset = LoadImagesAndLabels(path, imgsz, batch_size, augment=augment, # augment images
hyp=hyp, # augmentation hyperparameters
rect=rect, # rectangular training
cache_images=cache, single_cls=opt.single_cls, stride=int(stride), pad=pad, image_weights=image_weights, prefix=prefix,data_type=data_type)
@contextmanager
def torch_distributed_zero_first(local_rank: int):
"""
Decorator to make all processes in distributed training wait for each local_master to do something.
"""
if local_rank not in [-1, 0]:
torch.distributed.barrier()
yield
if local_rank == 0:
边栏推荐
猜你喜欢

Redis cache penetration, cache breakdown, cache avalanche

2018 mathematical modeling competition - special clothing design for high temperature operation

thrift

机 器 学 习

Dev++ 环境设置C语言关键字显示颜色

Proxy reflect usage details

IDEA一键生成Log日志

Assembly language - Wang Shuang Chapter 11 flag register - Notes

第 299 场周赛 第四题 6103. 从树中删除边的最小分数

Matlab GUI interface simulation DC motor and AC motor speed simulation
随机推荐
【LeetCode】Day90-二叉搜索树中第K小的元素
multiprocessing.pool详解
An Empirical Evaluation of In-Memory Multi-Version Concurrency Control
Gaussian distribution, linear regression, logistic regression
Yaml file encryption
HTAP Quick Start Guide
日期 数据库日期 字符串 之间互相转换
Proxy reflect usage details
2022 CISP-PTE(一)文件包含
HTAP 深入探索指南
卷积神经网络---CNN模型的应用(找矿预测)
JVM类加载机制
Currying Scala functions
观测电机转速转矩
路由器和交换机的区别
古典密码体制--代换和置换
EasyExcel:读取Excel数据到List集合中
JVM garbage collection mechanism
快速实现蓝牙iBeacn功能详解
Cloud-Native Database Systems at Alibaba: Opportunities and Challenges