volume 30 pages 2340-2349

EnlightenGAN: Deep Light Enhancement Without Paired Supervision

Yifan Jiang 1
Xinyu Gong 1
Ding Liu 2
Cheng Yu 3
Fang Chen 2
XIAOHUI SHEN 2
Jianchao Yang 2
Pan Zhou 4
Zhangyang Wang 1
Publication typeJournal Article
Publication date2021-01-22
scimago Q1
wos Q1
SJR2.502
CiteScore22.5
Impact factor13.7
ISSN10577149, 19410042
Computer Graphics and Computer-Aided Design
Software
Abstract
Deep learning-based methods have achieved remarkable success in image restoration and enhancement, but are they still competitive when there is a lack of paired training data? As one such example, this paper explores the low-light image enhancement problem, where in practice it is extremely challenging to simultaneously take a low-light and a normal-light photo of the same visual scene. We propose a highly effective unsupervised generative adversarial network, dubbed EnlightenGAN , that can be trained without low/normal-light image pairs, yet proves to generalize very well on various real-world test images. Instead of supervising the learning using ground truth data, we propose to regularize the unpaired training using the information extracted from the input itself, and benchmark a series of innovations for the low-light image enhancement problem, including a global-local discriminator structure, a self-regularized perceptual loss fusion, and the attention mechanism. Through extensive experiments, our proposed approach outperforms recent methods under a variety of metrics in terms of visual quality and subjective user study. Thanks to the great flexibility brought by unpaired training, EnlightenGAN is demonstrated to be easily adaptable to enhancing real-world images from various domains. Our codes and pre-trained models are available at: https://github.com/VITA-Group/EnlightenGAN .
Found 
Found 

Top-30

Journals

10
20
30
40
50
60
70
80
Lecture Notes in Computer Science
71 publications, 3.91%
IEEE Access
52 publications, 2.86%
Sensors
45 publications, 2.48%
IEEE Transactions on Multimedia
40 publications, 2.2%
IEEE Transactions on Circuits and Systems for Video Technology
40 publications, 2.2%
Signal, Image and Video Processing
36 publications, 1.98%
Applied Sciences (Switzerland)
33 publications, 1.82%
Neurocomputing
31 publications, 1.71%
Electronics (Switzerland)
28 publications, 1.54%
Pattern Recognition
27 publications, 1.49%
IEEE Transactions on Image Processing
27 publications, 1.49%
Engineering Applications of Artificial Intelligence
26 publications, 1.43%
IEEE Signal Processing Letters
26 publications, 1.43%
Multimedia Tools and Applications
24 publications, 1.32%
Digital Signal Processing: A Review Journal
24 publications, 1.32%
IEEE Transactions on Instrumentation and Measurement
24 publications, 1.32%
Visual Computer
23 publications, 1.27%
Signal Processing: Image Communication
23 publications, 1.27%
Expert Systems with Applications
23 publications, 1.27%
Scientific Reports
22 publications, 1.21%
Knowledge-Based Systems
20 publications, 1.1%
Journal of Visual Communication and Image Representation
20 publications, 1.1%
IET Image Processing
18 publications, 0.99%
IEEE Transactions on Pattern Analysis and Machine Intelligence
16 publications, 0.88%
Multimedia Systems
15 publications, 0.83%
IEEE Sensors Journal
15 publications, 0.83%
Displays
14 publications, 0.77%
IEEE Transactions on Intelligent Transportation Systems
14 publications, 0.77%
Computers and Graphics
13 publications, 0.72%
10
20
30
40
50
60
70
80

Publishers

100
200
300
400
500
600
700
800
Institute of Electrical and Electronics Engineers (IEEE)
738 publications, 40.64%
Elsevier
349 publications, 19.22%
Springer Nature
320 publications, 17.62%
MDPI
161 publications, 8.87%
Association for Computing Machinery (ACM)
48 publications, 2.64%
SPIE-Intl Soc Optical Eng
24 publications, 1.32%
Institution of Engineering and Technology (IET)
21 publications, 1.16%
Optica Publishing Group
20 publications, 1.1%
Wiley
18 publications, 0.99%
IOP Publishing
15 publications, 0.83%
Taylor & Francis
13 publications, 0.72%
Frontiers Media S.A.
9 publications, 0.5%
Public Library of Science (PLoS)
7 publications, 0.39%
Hans Publishers
5 publications, 0.28%
Shanghai Institute of Optics and Fine Mechanics
4 publications, 0.22%
SAGE
4 publications, 0.22%
AIP Publishing
4 publications, 0.22%
Research Square Platform LLC
4 publications, 0.22%
World Scientific
3 publications, 0.17%
Oxford University Press
3 publications, 0.17%
Hindawi Limited
3 publications, 0.17%
PeerJ
3 publications, 0.17%
Tsinghua University Press
3 publications, 0.17%
Tech Science Press
3 publications, 0.17%
Scientific Research Publishing
2 publications, 0.11%
Cambridge University Press
2 publications, 0.11%
King Saud University
2 publications, 0.11%
Institute of Electronics, Information and Communications Engineers (IEICE)
2 publications, 0.11%
IGI Global
2 publications, 0.11%
100
200
300
400
500
600
700
800
  • We do not take into account publications without a DOI.
  • Statistics recalculated weekly.

Are you a researcher?

Create a profile to get free access to personal recommendations for colleagues and new articles.
Metrics
1.8k
Share
Cite this
GOST |
Cite this
GOST Copy
Jiang Y. et al. EnlightenGAN: Deep Light Enhancement Without Paired Supervision // IEEE Transactions on Image Processing. 2021. Vol. 30. pp. 2340-2349.
GOST all authors (up to 50) Copy
Jiang Y., Gong X., Liu D., Cheng Yu, Chen F., SHEN X., Yang J., Zhou P., Wang Z. EnlightenGAN: Deep Light Enhancement Without Paired Supervision // IEEE Transactions on Image Processing. 2021. Vol. 30. pp. 2340-2349.
RIS |
Cite this
RIS Copy
TY - JOUR
DO - 10.1109/tip.2021.3051462
UR - https://doi.org/10.1109/tip.2021.3051462
TI - EnlightenGAN: Deep Light Enhancement Without Paired Supervision
T2 - IEEE Transactions on Image Processing
AU - Jiang, Yifan
AU - Gong, Xinyu
AU - Liu, Ding
AU - Cheng Yu
AU - Chen, Fang
AU - SHEN, XIAOHUI
AU - Yang, Jianchao
AU - Zhou, Pan
AU - Wang, Zhangyang
PY - 2021
DA - 2021/01/22
PB - Institute of Electrical and Electronics Engineers (IEEE)
SP - 2340-2349
VL - 30
PMID - 33481709
SN - 1057-7149
SN - 1941-0042
ER -
BibTex
Cite this
BibTex (up to 50 authors) Copy
@article{2021_Jiang,
author = {Yifan Jiang and Xinyu Gong and Ding Liu and Cheng Yu and Fang Chen and XIAOHUI SHEN and Jianchao Yang and Pan Zhou and Zhangyang Wang},
title = {EnlightenGAN: Deep Light Enhancement Without Paired Supervision},
journal = {IEEE Transactions on Image Processing},
year = {2021},
volume = {30},
publisher = {Institute of Electrical and Electronics Engineers (IEEE)},
month = {jan},
url = {https://doi.org/10.1109/tip.2021.3051462},
pages = {2340--2349},
doi = {10.1109/tip.2021.3051462}
}