[fairseq] error: typeerror:_ broadcast_ coalesced(): incompatible function arguments

Preface

I copied the model state_dict Method , Specifically, it adds dynamic_mask（ Dictionary type , Inside is tensor）,allocated_neuron_num（ integer ）.

def state_dict(self, destination=None, prefix='', keep_vars=False):
    state_dict = super().state_dict(destination, prefix, keep_vars)
    state_dict['model.dynamic_mask'] = gloVar.dynamic_mask
    state_dict['model.allocated_neuron_num'] = gloVar.allocated_neuron_num
    return state_dict

The result is wrong ：

  File "/data3/syxu/sparsenmt_exp/sparsenmt/fairseq/fairseq/models/distributed_fairseq_model.py", line 58, in DistributedFairseqModel
    wrapped_model = DistributedDataParallel(
  File "/data3/syxu/anaconda3/envs/torch18/lib/python3.8/site-packages/torch/nn/parallel/distributed.py", line 580, in __init__
    self._sync_params_and_buffers(authoritative_rank=0)
  File "/data3/syxu/anaconda3/envs/torch18/lib/python3.8/site-packages/torch/nn/parallel/distributed.py", line 597, in _sync_params_and_buffers
    self._distributed_broadcast_coalesced(
  File "/data3/syxu/anaconda3/envs/torch18/lib/python3.8/site-packages/torch/nn/parallel/distributed.py", line 1334, in _distributed_broadcast_coalesced
    dist._broadcast_coalesced(
TypeError: _broadcast_coalesced(): incompatible function arguments. The following argument types are supported:
    1. (process_group: torch._C._distributed_c10d.ProcessGroup, tensors: List[at::Tensor], buffer_size: int, src: int = 0) -> None

solve

Do not use the DistributedDataParallel. according to file , This is in fairseq It is embodied in –ddp-backend Parameters .
When reporting a mistake –ddp-backend=pytorch_ddp（ Default ）, Change it to legacy_ddp、no_c10d No more errors will be reported .

Reference resources

https://fairseq.readthedocs.io/en/latest/command_line_tools.html
https://blog.csdn.net/j___t/article/details/104368597