当前位置:网站首页>Three schemes of SVM to realize multi classification
Three schemes of SVM to realize multi classification
2022-07-06 21:01:00 【wx5d786476cd8b2】
SVM It is a binary classifier
SVM The algorithm was originally designed for binary classification problems , When dealing with multiple types of problems , We need to construct a suitable multi class classifier .
at present , structure SVM There are two main methods of multi class classifier
(1) direct method , Modify directly on the objective function , The parameter solutions of multiple classification surfaces are combined into an optimization problem , By solving the optimization problem “ Disposable ” Implementation of multi class classification . This method seems simple , But its computational complexity is relatively high , It's more difficult to achieve , Only suitable for small problems ;
(2) indirect method , Mainly through the combination of multiple two classifiers to achieve the construction of multiple classifiers , Common methods are one-against-one and one-against-all Two kinds of .
One to many (one-versus-rest, abbreviation OVR SVMs)
During the training, the samples of a certain category are classified into one category in turn , The rest of the samples fall into another category , such k Samples of categories construct k individual SVM. In classification, the unknown samples are classified into the category with the maximum classification function value .
If I had four categories ( That is to say 4 individual Label), They are A、B、C、D.
So when I was extracting the training set , Separate extraction
(1)A The corresponding vector is a positive set ,B,C,D The corresponding vector is a negative set ;
(2)B The corresponding vector is a positive set ,A,C,D The corresponding vector is a negative set ;
(3)C The corresponding vector is a positive set ,A,B,D The corresponding vector is a negative set ;
(4)D The corresponding vector is a positive set ,A,B,C The corresponding vector is a negative set ;
Use these four training sets to train separately , Then we get four training result files .
During the test , The corresponding test vectors are tested by using the four training result files .
In the end, each test has a result f1(x),f2(x),f3(x),f4(x).
So the final result is the largest of the four values as the classification result .
evaluation :
There's a flaw in this approach , Because the training set is 1:M, In this case there is biased. So it's not very practical . When extracting data sets , One third of the complete negative set is taken as the training negative set .
One on one (one-versus-one, abbreviation OVO SVMs perhaps pairwise)
This is done by designing a... Between any two types of samples SVM, therefore k Samples of each category need to be designed k(k-1)/2 individual SVM.
When classifying an unknown sample , The last category with the most votes is the category of the unknown sample .
Libsvm The multi class classification in is based on this method .
Suppose there are four types A,B,C,D Four types of . In training, I choose A,B; A,C; A,D; B,C; B,D;C,D The corresponding vector is used as the training set , And then we get six training results , During the test , Test the six results with the corresponding vectors , And then take the form of a vote , Finally, we get a set of results .
The vote is like this :
A=B=C=D=0;
(A,B)-classifier If it is A win, be A=A+1;otherwise,B=B+1;
(A,C)-classifier If it is A win, be A=A+1;otherwise, C=C+1;
...
(C,D)-classifier If it is A win, be C=C+1;otherwise,D=D+1;
The decision is the Max(A,B,C,D)
evaluation : This method is good , But when there are many categories ,model The number of is n*(n-1)/2, The cost is still considerable .
边栏推荐
- How to implement common frameworks
- How to upgrade high value-added links in the textile and clothing industry? APS to help
- Laravel notes - add the function of locking accounts after 5 login failures in user-defined login (improve system security)
- Yyds dry goods count re comb this of arrow function
- Pat 1085 perfect sequence (25 points) perfect sequence
- 性能测试过程和计划
- 【DSP】【第一篇】开始DSP学习
- Common doubts about the introduction of APS by enterprises
- [wechat applet] operation mechanism and update mechanism
- 如何实现常见框架
猜你喜欢
Redis insert data garbled solution
新型数据库、多维表格平台盘点 Notion、FlowUs、Airtable、SeaTable、维格表 Vika、飞书多维表格、黑帕云、织信 Informat、语雀
[DSP] [Part 2] understand c6678 and create project
SSO single sign on
Swagger UI教程 API 文档神器
防火墙基础之外网服务器区部署和双机热备
性能测试过程和计划
知识图谱构建流程步骤详解
Detailed explanation of knowledge map construction process steps
Implementation of packaging video into MP4 format and storing it in TF Card
随机推荐
C # use Oracle stored procedure to obtain result set instance
2022 portal crane driver registration examination and portal crane driver examination materials
2022 Guangdong Provincial Safety Officer C certificate third batch (full-time safety production management personnel) simulation examination and Guangdong Provincial Safety Officer C certificate third
知识图谱之实体对齐二
[weekly pit] output triangle
SAP UI5 框架的 manifest.json
R语言可视化两个以上的分类(类别)变量之间的关系、使用vcd包中的Mosaic函数创建马赛克图( Mosaic plots)、分别可视化两个、三个、四个分类变量的关系的马赛克图
[diy] how to make a personalized radio
Review questions of anatomy and physiology · VIII blood system
Laravel笔记-自定义登录中新增登录5次失败锁账户功能(提高系统安全性)
Interviewer: what is the internal implementation of ordered collection in redis?
(工作记录)2020年3月11日至2021年3月15日
硬件开发笔记(十): 硬件开发基本流程,制作一个USB转RS232的模块(九):创建CH340G/MAX232封装库sop-16并关联原理图元器件
强化学习-学习笔记5 | AlphaGo
[DIY]如何制作一款個性的收音機
2022 construction electrician (special type of construction work) free test questions and construction electrician (special type of construction work) certificate examination
I've seen many tutorials, but I still can't write a program well. How can I break it?
Solution to the 38th weekly match of acwing
Can novices speculate in stocks for 200 yuan? Is the securities account given by qiniu safe?
Comment faire une radio personnalisée