Transformer principle and code elaboration (pytorch)

Course link ：Transformer Principle and code elaboration （PyTorch）-1- Course is an introduction to - Bai Yong's online video tutorial -CSDN Programmer Institute

Transformer From NLP（ natural language processing ）, And cross-border application to CV（ Computer vision ） field . At present, it has become a new paradigm of deep learning , Great influence and application prospects .

This course is right Transformer Principle and PyTorch Elaborate the code , To help you master its detailed principle and specific implementation .

Principle elaboration part Include ： Attention mechanism and self attention mechanism 、Transformer An overview of the architecture 、Encoder Long attention （Multi-Head Attention）、Encoder The location code of （Positional Encoding）、 Residual link 、 Layer normalization （Layer Normalization）、FFN（Feed Forward Network）、Transformer Training and performance of 、Transformer Machine translation workflow .

Code elaboration part Use Jupyter Notebook Yes Transformer Of PyTorch code Line by line interpretation , Include ： install PyTorch、Transformer Of Encoder Code reading 、Transformer Of Decoder Code reading 、Transformer Super parameter setting code interpretation 、Transformer Training examples of （ Artificial random data ） Code reading 、Transformer Training examples of ( German - English machine translation ) Code reading .