当前位置:网站首页>Vit (vision transformer) principle and code elaboration
Vit (vision transformer) principle and code elaboration
2022-07-06 07:39:00 【bai666】
Course link : https://edu.51cto.com/course/30169.html
Transformer In many NLP( natural language processing ) In the mission SOTA The results of . ViT (Vision Transformer) yes Transformer be applied to CV( Computer vision ) Milestone work in the field , Later, more variants have been developed , Such as Swin Transformer.
ViT (Vision Transformer) Model published in paper An Image is Worth 16X16 Words: Transformer For Image Recognition At Scale, Use pure Transformer Image classification .ViT stay JFT-300M After pre training on the dataset , It can exceed convolutional neural network ResNet Performance of , And the training computing resources used can be less .
This course is right ViT Principle and PyTorch The implementation code is refined , To help you master its detailed principle and specific implementation . The code implementation includes two code implementation methods , One is to adopt timm library , The other is to adopt einops/einsum.
The principle part includes :Transformer An overview of the architecture 、Transformer Of Encoder 、Transformer Of Decoder、ViT Architecture Overview 、ViT The model, 、ViT Performance and analysis .
The refined part of the code uses Jupyter Notebook Yes ViT Of PyTorch Read the code line by line , Include : install PyTorch、ViT Of timm Library implementation code interpretation 、 einops/einsum 、ViT Of einops/einsum Implement code interpretation .
边栏推荐
- word怎么只删除英语保留汉语或删除汉语保留英文
- 软件测试界的三无简历,企业拿什么来招聘你,石沉大海的简历
- 杰理之BLE【篇】
- opencv学习笔记九--背景建模+光流估计
- Typescript variable scope
- 【mysql学习笔记29】触发器
- The ECU of 21 Audi q5l 45tfsi brushes is upgraded to master special adjustment, and the horsepower is safely and stably increased to 305 horsepower
- [CF Gym101196-I] Waif Until Dark 网络最大流
- [非线性控制理论]9_非线性控制理论串讲
- 学go之路(二)基本类型及变量、常量
猜你喜欢
The ECU of 21 Audi q5l 45tfsi brushes is upgraded to master special adjustment, and the horsepower is safely and stably increased to 305 horsepower
qt颜色与字符串、uint相互转换
MEX有关的学习
Sharing of source code anti disclosure scheme under burning scenario
[CF Gym101196-I] Waif Until Dark 网络最大流
opencv学习笔记八--答题卡识别
Typescript interface and the use of generics
解决方案:智慧工地智能巡检方案视频监控系统
Solution: intelligent site intelligent inspection scheme video monitoring system
Simulation of holographic interferogram and phase reconstruction of Fourier transform based on MATLAB
随机推荐
Iterator Foundation
[CF Gym101196-I] Waif Until Dark 网络最大流
OpenJudge NOI 2.1 1661:Bomb Game
洛谷P1836 数页码 题解
[computer skills]
[cf gym101196-i] waif until dark network maximum flow
CF1036C Classy Numbers 题解
leecode-C語言實現-15. 三數之和------思路待改進版
成为优秀的TS体操高手 之 TS 类型体操前置知识储备
qt颜色与字符串、uint相互转换
Summary of Digital IC design written examination questions (I)
Apache middleware vulnerability recurrence
Wonderful use of TS type gymnastics string
Get the path of edge browser
Opencv learning notes 9 -- background modeling + optical flow estimation
Description of octomap averagenodecolor function
[dictionary tree] [trie] p3879 [tjoi2010] reading comprehension
Ble of Jerry [chapter]
Launch APS system to break the problem of decoupling material procurement plan from production practice
edge瀏覽器 路徑獲得