SIA OpenIR  > 光电信息技术研究室
基于生成对抗网络的红外图像数据增强
Alternative TitleInfrared images data augmentation based on generative adversarial networks
陈佛计1,2,3,4; 朱枫1,2,3,4; 吴清潇1,2,3,4; 郝颖明1,2,3,4; 王恩德1,2,3,4
Department光电信息技术研究室
Source Publication计算机应用
ISSN1001-9081
2020
Volume40Issue:7Pages:2084-2088
Indexed ByCSCD
CSCD IDCSCD:6766332
Funding Organization国家自然科学基金项目 (U1713216)
Keyword红外图像生成 生成对抗网络 图像转换 数据增强 生成图像质量评估
Abstract

深度学习在视觉任务中的良好表现很大程度上依赖于海量的数据和计算力的提升,但是在很多实际项目中,通常难以提供足够的数据来完成任务。针对某些情况下红外图像少且难以获得的问题,提出一种基于彩色图像生成红外图像的方法来获取更多的红外图像数据。该方法首先用现有的彩色图像和红外图像数据构建成对的数据集;然后,基于卷积神经网络、转置卷积神经网络构建生成对抗网络(GAN)模型的生成器和鉴别器;接着,基于成对的数据集来训练生成对抗网络模型,直到生成器和鉴别器之间达到纳什平衡状态;最后,用训练好的生成器将彩色图像从彩色域变换到红外域。实验结果表明,该方法可以生成高质量的红外图像,并且基于定量的评估方法(FID)对实验结果进行了验证,相较于在损失函数中不加正则化项,在损失函数中加入L1和L2正则化约束后,FID分数值平均分别降低了23.95和20.89。作为一种无监督的数据增强方法,该方法可以被应用于其他缺少数据的目标识别、目标检测、数据不平衡等视觉任务中。

Other Abstract

The great performance of deep learning in many visual tasks largely depends on the improvement of computing power and big data volume. But in many practical projects, it is usually difficult to provide enough data to complete the task. Concern the problem that the infrared data sets are small and the infrared data is hard to collect, a method to generate infrared images based on color images to obtain more infrared image data was proposed. Firstly, the existing color image and infrared image data were employed to construct a paired dataset. Secondly, the generator and the discriminator of the Generative Adversarial Network(GAN)model were formed based on the convolutional neural network and the transposed convolutional neural network. And then, the GAN model was trained based on the paired dataset. Finally, the trained generator was used to transform the color image from the color field to the infrared field. The experimental results show that this method can generate high-quality infrared images and is verified based on quantitative evaluation methods. After the L1 or L2 regularization constraint was added to the loss function, the Fréchet Inception Distance (FID) score was respectively reduced by 23.95, 20.89 on average compared to when not added. As an unsupervised data augmentation method, it can be applied to many other visual tasks that lack train data, such as target recognition, target detection, data imbalance, etc.

Language中文
Citation statistics
Document Type期刊论文
Identifierhttp://ir.sia.cn/handle/173321/26553
Collection光电信息技术研究室
Corresponding Author陈佛计
Affiliation1.中国科学院沈阳自动化研究所
2.中国科学院机器人与智能制造创新研究院
3.中国科学院大学
4.中国科学院光电信息处理重点实验室
Recommended Citation
GB/T 7714
陈佛计,朱枫,吴清潇,等. 基于生成对抗网络的红外图像数据增强[J]. 计算机应用,2020,40(7):2084-2088.
APA 陈佛计,朱枫,吴清潇,郝颖明,&王恩德.(2020).基于生成对抗网络的红外图像数据增强.计算机应用,40(7),2084-2088.
MLA 陈佛计,et al."基于生成对抗网络的红外图像数据增强".计算机应用 40.7(2020):2084-2088.
Files in This Item:
File Name/Size DocType Version Access License
基于生成对抗网络的红外图像数据增强.pd(2559KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Application Full Text
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[陈佛计]'s Articles
[朱枫]'s Articles
[吴清潇]'s Articles
Baidu academic
Similar articles in Baidu academic
[陈佛计]'s Articles
[朱枫]'s Articles
[吴清潇]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[陈佛计]'s Articles
[朱枫]'s Articles
[吴清潇]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: 基于生成对抗网络的红外图像数据增强.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.