Paddlepaddle 34 adjust the layer structure and forward process of the model (realize the addition, deletion, modification and forward modification of the layer)

Generally speaking, adjusting the model layer Structure and forward The process needs to modify the definition code of the model , This will pollute the original model definition code . And , After modifying the model structure at the source level , It will make the model unable to load and adapt to the previous pre training parameters . For this reason, bloggers have realized that without polluting the model definition code , Only on model Object for property modification , The model layer Structure and forward Process adjustment . Originally, the blogger was pytorch The following is that the work has been realized （ Implement links ）, But when applied to paddle There is acclimatization , So for paddle The framework does the work here .

This blog is mainly set layer New 、 Modify and delete ,forward Process modification . among ,layer The revision of is already in Section of this column 29 Chapter Realized . Here is a brief introduction .

1、layer Modification and deletion of

layer The modification and deletion of are in paddle model In fact, it is the same thing , Modification means that layer Replace with new layer, Delete means to delete layer Replace empty layer（nn.Sequential() object ）. Its core is to realize layer Replacement , The replacement code is as follows ：

import paddle
def _set_module(model,</