当前位置:网站首页>ACM multimedia 2022 | counterfactual measurement and elimination of social prejudice in visual language pre training model
ACM multimedia 2022 | counterfactual measurement and elimination of social prejudice in visual language pre training model
2022-07-04 22:09:00 【Zhiyuan community】
Paper title :
Counterfactually Measuring and Eliminating Social Bias in Vision-Language Pre-training Models
Thesis link :
https://arxiv.org/submit/4382207
Code and dataset :
https://github.com/VL-Bias/VL-Bias
In this work , We aim at VLP Multimodal characteristics of the model , Based on the counterfactual sample generation, the social prejudice of each mode and the social prejudice of multimodal integration are measured . Measuring social prejudice in the pre training model is essentially the concept of measuring prejudice ( such as , Gender and other social attributes ) And the concept of goals .
We propose a bias measurement method based on counterfactual CounterBias, For each sample, counterfactual samples on bias attributes are generated , Then use the modeling changes of the target attributes before and after the counterfactual model to measure the relationship between the concept of bias and the concept of target .
Because there is no ready-made data set for analysis VLP Social prejudice in the model , We proposed VL-Bias Data sets , It is used in this work and in the community VLP Understanding of social prejudice in the model .VL-Bias contain 24K Picture and text right , The target attribute includes 52 Two actions and 13 A career . stay VL-Bias On dataset , Use CounterBias, We tested two typical VLP structure , Single stream VLP And Shuangliu VLP. Key observations include :(1) The test of VLP There are social biases in the model , Both visual mode and text mode exist ;(2) Included in VLP The social prejudice in the model is basically consistent with the influence of human stereotypes ;(3) Tested single stream architecture VLP And dual flow architecture VLP The bias in the two modes shows different consistency ;(4) The test of VLP The model shows better performance than BERT Stronger gender bias .
Inherited CounterBias Counterfactual thinking in , We propose a simple but effective method FiarVLP eliminate VLP Social prejudice in the model . say concretely , We first generate counterfactual samples of biased concepts in visual and linguistic modalities . then MLM The task minimizes the probability difference between the prediction of facts and counterfactual , So as to prevent the correlation between model learning deviation and target concept . The result of the experiment proves that FairVLP The effectiveness of the .
边栏推荐
- Cadre WebGIS - kalrry
- Enabling digital economy Fuxin software attends the BRICs high level Forum on Sustainable Development
- GTEST from ignorance to proficiency (3) what are test suite and test case
- TCP protocol three times handshake process
- QT—双缓冲绘图
- Which securities company has the lowest Commission for opening an account online? I want to open an account. Is it safe to open an account online
- 并发网络模块化 读书笔记转
- # 2156. Find the substring of the given hash value - post order traversal
- new IntersectionObserver 使用笔记
- ACM Multimedia 2022 | 视觉语言预训练模型中社会偏见的反事实衡量和消除
猜你喜欢
Deveco device tool 3.0 release brings five capability upgrades to make intelligent device development more efficient
玩转gRPC—深入概念与原理
迷失在Mysql的锁世界
并发网络模块化 读书笔记转
Bizchart+slider to realize grouping histogram
bizchart+slider实现分组柱状图
Analyzing the maker space contained in steam Education
i. Mx6ull driver development | 24 - platform based driver model lights LED
机器学习笔记 - 互信息Mutual Information
QT—绘制其他问题
随机推荐
哈希表(Hash Tabel)
i. Mx6ull driver development | 24 - platform based driver model lights LED
WebGIS framework -- kalrry
淘宝商品评价api接口(item_review-获得淘宝商品评论API接口),天猫商品评论API接口
Radio and television Wuzhou signed a cooperation agreement with Huawei to jointly promote the sustainable development of shengteng AI industry
机器人相关课程考核材料归档实施细则2022版本
Bookmark
VS2019 C# release下断点调试
案例分享|金融业数据运营运维一体化建设
Interview question 01.01 Determine whether the character is unique
Enlightenment of maker thinking in Higher Education
【米哈游2023届秋招】开启【校招唯一专属内推码EYTUC】
更强的 JsonPath 兼容性及性能测试之2022版(Snack3,Fastjson2,jayway.jsonpath)
Exclusive interview of open source summer | new committer Xie Qijun of Apache iotdb community
WebGIS框架---kalrry
283. Moving zero-c and language assisted array method
从RepVgg到MobileOne,含mobileone的代码
MongoDB中的索引操作总结
Monitor the shuttle return button
TCP协议三次握手过程