Summary of sequential, modulelist, and moduledict usage in pytorch

The following is from ：

PyTorch Medium Sequential、ModuleList and ModuleDict Usage Summary _ Non late blog -CSDN Blog

1. Differences and connections
Let's start with a picture , To sum up their differences ：

difference

nn.Sequential Internally implemented forward function , So you don't have to write forward function . and nn.ModuleList and nn.ModuleDict There is no implementation of internal forward function .

nn.Sequential It needs to be carried out in strict order , The other two modules can be called arbitrarily .

Here are the introduction .

1.1 nn.Sequential You cannot freely add or delete

nn.Sequential The modules inside are arranged in order , Therefore, it must be ensured that the output size of the previous module is consistent with the input size of the next module , Cannot add freely , Delete .

nn.Sequential Can be used in OrderedDict To specify each module Name .
1.2