当前位置：网站首页>论文阅读_中文NLP_ELECTRA
论文阅读_中文NLP_ELECTRA
2022-07-03 04:39:00 【xieyan0811】
- 介绍：ELECTRA由Manning联合谷歌发布，后来哈工大讯飞联合实验室训练了相应的中文模型。精减后的模型效果和BERT差不太多，而模型大小只有BERT的1/10，ELECTRA-small 只有46M。
- 代码&模型下载&详细说明：https://github.com/ymcui/Chinese-ELECTRA
- 使用：LTP使用它为基础模型。
- 原理：使用生成对抗网络训练自然语言模型，时间短，参数少。模型分为两部分：生成器和判别器，生成实现MLM，判别器用于识别每一个单词是否为模型生成。
- 效果：以中文阅读理解为例，其效果对比如下，其它实验详见github
边栏推荐
- Reptile exercise 02
- 【SQL注入点】注入点出现位置、判断
- IPhone x forgot the boot password
- Asp access teaching management system design finished product
- [set theory] binary relationship (special relationship type | empty relationship | identity relationship | global relationship | divisive relationship | size relationship)
- Truncated sentences of leetcode simple questions
- Leetcode simple question: check whether the string is an array prefix
- Kubernetes source code analysis (I)
- 带有注意力RPN和多关系检测器的小样本目标检测网络（提供源码和数据及下载）...
- Small sample target detection network with attention RPN and multi relationship detector (provide source code, data and download)
猜你喜欢
Golang -- realize file transfer
Preliminary cognition of C language pointer
X-ray normal based contour rendering
The least operation of leetcode simple problem makes the array increment
Triangular rasterization
2022 Shandong Province safety officer C certificate examination content and Shandong Province safety officer C certificate examination questions and analysis
Employee attendance management system based on SSM
Bugku CTF daily question baby_ flag. txt
Network security textual research recommendation
Know that Chuangyu cloud monitoring - scanv Max update: Ecology OA unauthorized server request forgery and other two vulnerabilities can be detected
随机推荐
Introduction to message queuing (MQ)
2022 P cylinder filling test content and P cylinder filling simulation test questions
When using the benchmarksql tool to preheat data for kingbasees, execute: select sys_ Prewarm ('ndx_oorder_2 ') error
P35-P41 fourth_ context
How to use kotlin to improve productivity: kotlin tips
MediaTek 2023 IC written examination approved in advance (topic)
Basic use of continuous integration server Jenkins
I stepped on a foundation pit today
2022 registration of G2 utility boiler stoker examination and G2 utility boiler stoker reexamination examination
使用BENCHMARKSQL工具对KingbaseES预热数据时执行：select sys_prewarm(‘NDX_OORDER_2 ‘)报错
文献阅读_基于多模态数据语义融合的旅游在线评论有用性识别研究（中文文献）
How do you use lodash linking function- How do you chain functions using lodash?
2022 Shandong Province safety officer C certificate examination content and Shandong Province safety officer C certificate examination questions and analysis
Learning practice: comprehensive application of cycle and branch structure (I)
Priv app permission exception
Summary of training competition (Lao Li's collection of questions)
[set theory] Cartesian product (concept of Cartesian product | examples of Cartesian product | properties of Cartesian product | non commutativity | non associativity | distribution law | ordered pair
vulnhub HA: Natraj
2022 new examination questions for the main principals of hazardous chemical business units and examination skills for the main principals of hazardous chemical business units
【SQL注入点】注入点出现位置、判断