当前位置:网站首页>Image fusion DDcGAN study notes
Image fusion DDcGAN study notes
2022-08-03 12:22:00 【qq_46165876】
DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion Article Study Notes
Feature: Dual Discriminator
Model Structure
The whole process of DDcGAN is shown in the figure.Given a visible light image v and an infrared image I, our ultimate goal is to learn a generator G conditioned on them, and the generated images G(v, I) are encouraged to be sufficiently realistic and informative todeceive the authenticator.
Meanwhile, we utilize two opposing discriminators, Dv and Di, which each generate a scalar that estimates the probability of input from real data rather than G.
Specifically, Dv aims to discriminate generated images from visible light images, while Di is trained to discriminate between original low-resolution infrared images and downsampled generated/fused images.Average pooling is used here for downsampling, since average pooling preserves low-frequency information compared to max pooling, and thermal radiation information is mainly presented in this form.In other words, for balance between generator and discriminator, we do not feed source images v and I as additional/conditional information to Dv and di other than the input to the discriminator.That is, the input layer of each discriminator is a single-channel layer containing the sampled data, rather than a two-channel layer containing the sampled data and the corresponding source image as conditional information.Because when the conditions and samples to be discriminated are the same, the discrimination task is simplified to judge whether the input images are the same, and this is a simple enough task for the neural network.When the generator cannot fool the discriminator, the adversarial relationship cannot be established, and the generator will tend to generate randomly.
Difference between PG and two true distributions (i.e. PV and PI)through the adversarial process of generator G and two discriminators (Dv and Di)will simultaneously become smaller, where PG is the probability distribution of the generated samples and PV is the true distribution of the visible image>, PI is the true distribution of the infrared image.
Generator loss function
GeneratorLoss function
where adversarial loss is defined as
where loss of content is defined as
The discriminators in DDcGAN, namely Dv and Di,It plays the role of discriminating the source image and the generated fused image.The adversarial loss of the discriminator can compute the JS divergence between distributions to identify whether intensity or texture information is inauthentic, thereby encouraging matching the true distribution.
Discriminator loss function
边栏推荐
猜你喜欢
ROS中编译通过但是遇到可执行文件找不到的问题
AMS simulation
"Digital Economy Panorama White Paper" Financial Digital User Chapter released!
4500字归纳总结,一名软件测试工程师需要掌握的技能大全
After completing the interview and clearance collection of Alibaba, I successfully won the 15th Offer this year
Unsupervised learning KMeans notes and examples
零信任的基本概念【新航海】
FE主导打造一个运营活动平台
子结点的数量
第四课 标识符、关键字、变量、变量的分类和作用域、常量
随机推荐
数据库系统原理与应用教程(076)—— MySQL 练习题:操作题 160-167(二十):综合练习
Vs Shortcut Keys---Explore Different Programming
nacos应用
Kubernetes 网络入门
What knowledge points do you need to master to learn software testing?
【Verilog】HDLBits题解——Circuits/Sequential Logic/Latches and Flip-Flops
mysql进阶(二十四)防御SQL注入的方法总结
我在母胎SOLO20年
利用ChangeStream实现Amazon DocumentDB表级别容灾复制
信创建设看广州|海泰方圆亮相2022 信创生态融合发展论坛
Knowledge Graph Question Answering System Based on League of Legends
PC client automation testing practice based on Sikuli GUI image recognition framework
awk入门教程
LyScript implements memory stack scanning
ThreadLocal源码解析及使用场景
Chapter 15 Source Code File REST API Introduction
后台图库上传功能
子结点的数量
R语言绘制时间序列的自相关函数图:使用acf函数可视化时间序列数据的自相关系数图
一次内存泄露排查小结