当前位置:网站首页>How to excavate and research ideas from the paper
How to excavate and research ideas from the paper
2022-07-05 07:49:00 【Fall in love with wx】
1 Patching :
Hit it right in the face and it will be fatal
With MAE For example : be based on ViT + BERT,ViT The shortcomings of the article mentioned in the paper are BERT The effect is not good , Based on this MAE Two improvements have been made , First, mask more picture blocks ( The purpose is to make the pictures less integrated , Increase the challenge of the task ), And when encoding, only the uncovered blocks are processed to speed up ; The second is to use Transformer Block to output, namely decoding . The first idea is actually the process of data enhancement , To prevent the model from over fitting , because ViT The convergence of is very slow , So it's natural to think of the first idea : Whether it can be used *** Data to enhance *** To ensure the effect of the model at the same time *** Reduce training time ***; Second thought : Whether it can be used *** New architecture *** Instead of ViT; The third idea : in the light of BERT*** Loss function *** Whether it can be improved ( such as Contrastive Learning);
Considering the details of the paper, which point can make it better , After listing your thoughts , We must use experiments to verify , And provide new ideas through the experimental results . When patching, do not simply list , Must pass a *** The story connects the patches ***, That is to test the ability of writing . There is also a lot of technology in choosing the paper to patch , The preferred *** The patch space of the new paper is relatively large ***; Second, consider the actual situation of the hardware ; Of course, you can also consider accelerating training , Reduce the calculation cost as an idea .
Patching is actually aimed at a certain paper ( Preferably a new paper ) Improve the deficiencies in , For the specific details in the paper , Think about whether you can think of a better way to make up , And through experiments to verify and conceive new ideas again .
To be continued ~
边栏推荐
- 万字详解八大排序 必读(代码+动图演示)
- Package ‘*****‘ has no installation candidate
- GPIO circuit principle of stm32
- 1089 insert or merge, including test point 5
- Function of static
- STM32 knowledge points
- Differences between pycharm and idle and process -- join() in vs Code
- . Net service governance flow limiting middleware -fireflysoft RateLimit
- Temperature sensor DS18B20 principle, with STM32 routine code
- Realization of binary relation of discrete mathematics with C language and its properties
猜你喜欢
Realization of binary relation of discrete mathematics with C language and its properties
Use of orbbec Astra depth camera of OBI Zhongguang in ROS melody
Differences between pycharm and idle and process -- join() in vs Code
With the help of Navicat for MySQL software, the data of a database table in different or the same database link is copied to another database table
Idea common settings
mysql 盲注常见函数
软件设计师:03-数据库系统
Thunderbird tutorial \ easy to use mail client
Altium Designer 19.1.18 - 更改铺铜的透明度
From then on, I understand convolutional neural network (CNN)
随机推荐
About the problem that MySQL connector net cannot be cleared in MySQL
mysql 盲注常见函数
Pit record of Chmod 2 options in deepin
大学生活的自我总结-大一
Detailed explanation of C language pointer
Application of ultra pure water particle counter in electronic semiconductors
Exit of pyGame, idle and pycharm
QT excellent articles
NSIS finds out whether the file exists and sets the installation path
Scm-05 basis of independent keyboard
Altium designer 19.1.18 - hide the fly line of a network
msys2
cygwin
Ten thousand words detailed eight sorting must read (code + dynamic diagram demonstration)
IC software learning
Linked list (establishment, deletion, insertion and printing of one-way linked list)
[popular science] some interesting things that I don't know whether they are useful or not
Could NOT find XXX (missing: XXX_LIBRARY XXX_DIR)
A series of problems in offline installation of automated test environment (ride)
Oracle-触发器和程序包