当前位置:网站首页>Thesis reading_ ICD code_ MSMN
Thesis reading_ ICD code_ MSMN
2022-07-03 04:43:00 【xieyan0811】
Introduce
English title :Code Synonyms Do Matter: Multiple Synonyms Matching Network for Automatic ICD Coding
Chinese title : Automatically ICD Encoded synonym matching network
Address of thesis :https://export.arxiv.org/pdf/2203.01515.pdf
field : natural language processing 、 Biomedical
Time of publication :2022
author :Zheng Yuan etc. , Tsinghua University , Alibaba
Source :ACL
Code and data : https://github.com/GanjinZero/ICD-MSMN
Reading time :2022.06.14
Journal entry
By substituting external resources UMLS, Papers collected Synonyms for each code , So as to make up for the electronic medical record and ICD The problem of different synonyms in coding description .
Its algorithm is not as sophisticated as some previous models , But after introducing external resources , The effect is indeed improved a lot .
extensive reading
- Aiming at problems :ICD One meaning multi word problem in coding
- The core approach :
- Put forward Multi synonym matching network (MSMN)
- Use LSTM+ Long attention
- Will encode synonyms As query Focus on different phrases in the description , So as to generate and ICD Coding related representations .
- Use Biaffine ICD code Text representation of similarity , For final classification .
- Understanding after extensive reading :
- After half an hour , Half an hour to tidy up ( This is a short passage )
Method
ICD Encoding synonyms
Use UMLS( Integrated medical language system ) Knowledge map , Yes ICD Code description for extension , First , Describe the code l1 And UMLS Concept unique identifier in CUIs alignment ; And then from UMLS The selections in have the same CUIs Synonyms of English terms , And by deleting hyphens and words “NOS” To add additional synonyms . To each of them ICD Code generation {l2,l3…lM} Text , The following is used N Indicates the number of words contained in each description .
code
Use LSTM As an encoder , Use the pre trained word vector to translate words wi mapping xi, Use d Two way of layer LSTM, Embed words as input , Calculate its hidden layer as a representation .
When encoding synonyms , Encode with the same encoder , Then get its representation with maximum pooling :
Multiple synonyms attention
Inspired by the attention of many heads , In this paper, we use Multiple synonyms attention , Cut the hidden layer into M block (M head ):
here , Use the expression of encoding synonyms qj To query Hj, use Hj and qj Linear transformation of Calculate attention score a; The relevant encoding of text and code synonyms is available Ha Get . Aggregate encoding based text representation v, When you only need to work with When a code matches , Use
classifier
The classifier is used to judge the text S Does it include ICD code l, Based on the previously calculated dependency coding The text means vl and Coded representation qj, Use double affine transformation to measure the similarity of classification .
Before, many models only relied on coding , Therefore, it is necessary to include instances of each coding in the training set , And here it is q Is a text representation based on encoding , therefore , What we learn is The relationship between texts , It has nothing to do with the specific code .
Training
Cross entropy is used to calculate the difference between the prediction probability and the actual label :
边栏推荐
- Market status and development prospect prediction of global neutral silicone sealant industry in 2022
- [tools run SQL blind note]
- Employee attendance management system based on SSM
- 论文阅读_ICD编码_MSMN
- [set theory] binary relation (example of binary relation operation | example of inverse operation | example of composite operation | example of limiting operation | example of image operation)
- Priv app permission exception
- LVS load balancing cluster of efficient multi-purpose cluster (NAT mode)
- After job hopping at the end of the year, I interviewed more than 30 companies in two weeks and finally landed
- Leetcode simple question: check whether the array is sorted and rotated
- [PHP vulnerability weak type] basic knowledge, PHP weak equality, error reporting and bypassing
猜你喜欢
关于开学的准备与专业认知
Network security textual research recommendation
2022 t elevator repair simulation examination question bank and t elevator repair simulation examination question bank
SSM based campus part-time platform for College Students
Preparation for school and professional cognition
String matching: find a substring in a string
《牛客刷verilog》Part II Verilog进阶挑战
Leetcode simple problem delete an element to strictly increment the array
2022 new examination questions for the main principals of hazardous chemical business units and examination skills for the main principals of hazardous chemical business units
Symbol of array element product of leetcode simple problem
随机推荐
Asp access teaching management system design finished product
Ffmpeg tanscoding transcoding
2022 t elevator repair simulation examination question bank and t elevator repair simulation examination question bank
Market status and development prospects of the global IOT active infrared sensor industry in 2022
[USACO 2009 Dec S]Music Notes
Apache MPM model and ab stress test
[BMZCTF-pwn] 20-secret_ file
Introduction to JVM principle
Preparation for school and professional cognition
并发操作-内存交互操作
Wine travel Jianghu War: Ctrip is strong, meituan is strong, and Tiktok is fighting
[set theory] binary relationship (binary relationship notation | binary relationship from a to B | number of binary relationships | example of binary relationship)
Valentine's day limited withdrawal guide: for one in 200 million of you
FISCO bcos zero knowledge proof Fiat Shamir instance source code
After reviewing MySQL for a month, I was stunned when the interviewer of Alibaba asked me
The simple problem of leetcode: dismantling bombs
[free completion] development of course guidance platform (source code +lunwen)
Small program animation realizes the running lantern and animation object
Leetcode simple problem delete an element to strictly increment the array
Smart contract security audit company selection analysis and audit report resources download - domestic article