Lighting the Darkness in the Deep Learning Era: A Survey, An Online Platform, A New Dataset

Overview

Lighting the Darkness in the Deep Learning Era: A Survey, An Online Platform, A New Dataset

This repository provides a unified online platform, LoLi-Platform http://mc.nankai.edu.cn/ll/, that covers many popular deep learning-based LLIE methods, of which the results can be produced through a user-friendly web interface, contains a low-light image and video dataset, LoLi-Phone (will be released soon), in which the images and videos are taken by various phones' cameras under diverse illumination conditions and scenes, and collects deep learning-based low-light image and video enhancement methods, datasets, and evaluation metrics. More content and details can be found in our Survey Paper: Lighting the Darkness in the Deep Learning Era. We provide the comparison results on the real low-light videos taken by different mobile phones’ cameras at YouTube https://www.youtube.com/watch?v=Elo9TkrG5Oo&t=6s.

We will periodically update the content. Welcome to let us know if we miss your work that is published in top-tier Journal or conference. We will add it.

Our LoLi-Platform supports the function of download. Please right click and then save the figure.

If you use this dataset or platform, please cite our paper. Please hit the star at the top-right corner. Thanks!

Contents

  1. LoLi-Platform
  2. LoLi-Phone Dataset
  3. Methods
  4. Datasets
  5. Metrics
  6. Citation

LoLi-Platform

Currently, the LoLi-Platform covers 13 popular deep learning-based LLIE methods including LLNet, LightenNet, Retinex-Net, EnlightenGAN, MBLLEN, KinD, KinD++, TBEFN, DSLR, DRBN, ExCNet, Zero-DCE, and RRDNet, where the results of any inputs can be produced through a user-friendly web interface. Have fun: LoLi-Platform.

LoLi-Phone

Overview LoLi-Phone dataset contains 120 videos (55,148 images) taken by 18 different phones' cameras including iPhone 6s, iPhone 7, iPhone7 Plus, iPhone8 Plus, iPhone 11, iPhone 11 Pro, iPhone XS, iPhone XR, iPhone SE, Xiaomi Mi 9, Xiaomi Mi Mix 3, Pixel 3, Pixel 4, Oppo R17, Vivo Nex, LG M322, OnePlus 5T, Huawei Mate 20 Pro under diverse illumination conditions (e.g., weak illumination, underexposure, dark, extremely dark, back-lit, non-uniform light, color light sources, etc.) in the indoor and outdoor scenes. Anyone can access the LoLi-Phone dataset.

Methods

Overview

Date Publication Title Abbreviation Code Platform
2017 PR LLNet: A deep autoencoder approach to natural low-light image enhancement paper LLNet Code Theano
2018 PRL LightenNet: A convolutional neural network for weakly illuminated image enhancement paper LightenNet Code Caffe & MATLAB
2018 BMVC Deep retinex decomposition for low-light enhancement paper Retinex-Net Code TensorFlow
2018 BMVC MBLLEN: Low-light image/video enhancement using CNNs paper MBLLEN Code TensorFlow
2018 TIP Learning a deep single image contrast enhancer from multi-exposure images paper SCIE Code Caffe & MATLAB
2018 CVPR Learning to see in the dark paper Chen et al. Code TensorFlow
2018 NeurIPS DeepExposure: Learning to expose photos with asynchronously reinforced adversarial learning paper DeepExposure TensorFlow
2019 ICCV Seeing motion in the dark paper Chen et al. Code TensorFlow
2019 ICCV Learning to see moving object in the dark paper Jiang and Zheng Code TensorFlow
2019 CVPR Underexposed photo enhancement using deep illumination estimation paper DeepUPE Code TensorFlow
2019 ACMMM Kindling the darkness: A practical low-light image enhancer paper KinD Code TensorFlow
2019 ACMMM (IJCV) Kindling the darkness: A practical low-light image enhancer paper (Beyond brightening low-light images paper) KinD (KinD++) Code TensorFlow
2019 ACMMM Progressive retinex: Mutually reinforced illumination-noise perception network for low-light image enhancement paper Wang et al. Caffe
2019 TIP Low-light image enhancement via a deep hybrid network paper Ren et al. Caffe
2019(2021) arXiv(TIP) EnlightenGAN: Deep light enhancement without paired supervision paper arxiv EnlightenGAN Code PyTorch
2019 ACMMM Zero-shot restoration of back-lit images using deep internal learning paper ExCNet Code PyTorch
2020 CVPR Zero-reference deep curve estimation for low-light image enhancement paper Zero-DCE Code PyTorch
2020 CVPR From fidelity to perceptual quality: A semi-supervised approach for low-light image enhancement paper DRBN Code PyTorch
2020 ACMMM Fast enhancement for non-uniform illumination images using light-weight CNNs paper Lv et al. TensorFlow
2020 ACMMM Integrating semantic segmentation and retinex model for low light image enhancement paper Fan et al.
2020 CVPR Learning to restore low-light images via decomposition-and-enhancement paper Xu et al. PyTorch
2020 AAAI EEMEFN: Low-light image enhancement via edge-enhanced multi-exposure fusion network paper EEMEFN PyTorch
2020 TIP Lightening network for low-light image enhancement paper DLN PyTorch
2020 TMM Luminance-aware pyramid network for low-light image enhancement paper LPNet PyTorch
2020 ECCV Low light video enhancement using synthetic data produced with an intermediate domain mapping paper SIDGAN TensorFlow
2020 TMM TBEFN: A two-branch exposure-fusion network for low-light image enhancement paper TBEFN Code TensorFlow
2020 ICME Zero-shot restoration of underexposed images via robust retinex decomposition paper RRDNet Code PyTorch
2020 TMM DSLR: Deep stacked laplacian restorer for low-light image enhancement paper DSLR Code PyTorch

Datasets

Abbreviation Number Format Real/Synetic Video Paired/Unpaired/Application Dataset
LOL paper 500 RGB Real No Paired Dataset
SCIE paper 4413 RGB Real No Paired Dataset
MIT-Adobe FiveK paper 5000 Raw Real No Paired Dataset
SID paper 5094 Raw Real No Paired Dataset
DRV paper 202 Raw Real Yes Paired Dataset
SMOID paper 179 Raw Real Yes Paired Dataset
LIME paper 10 RGB Real No Unpaired Dataset
NPE paper 84 RGB Real No Unpaired Dataset
MEF paper 17 RGB Real No Unpaired Dataset
DICM paper 64 RGB Real No Unpaired Dataset
VV 24 RGB Real No Unpaired Dataset
ExDARK paper 7363 RGB Real No Application Dataset
BBD-100K paper 10,000 RGB Real Yes Application Dataset
DARK FACE paper 6000 RGB Real No Application Dataset

Metrics

Abbreviation Full-/Non-Reference Platform Code
MAE (Mean Absolute Error) Full-Reference
MSE (Mean Square Error) Full-Reference
PSNR (Peak Signal-to-Noise Ratio) Full-Reference
SSIM (Structural Similarity Index Measurement) Full-Reference MATLAB Code
LPIPS (Learned Perceptual Image Patch Similarity) Full-Reference PyTorch Code
LOE (Lightness Order Error) Non-Reference MATLAB Code
NIQE (Naturalness Image Quality Evaluator) Non-Reference MATLAB Code
PI (Perceptual Index) Non-Reference MATLAB Code
SPAQ (Smartphone Photography Attribute and Quality) Non-Reference PyTorch Code
NIMA (Neural Image Assessment) Non-Reference PyTorch/TensorFlow Code/Code

Citation

If you find the repository helpful in your resarch, please cite the following paper.

@article{LoLi,
  title={Lighting the Darkness in the Deep Learning Era},
  author={Li, Chongyi and Guo, Chunle and Han, Linghao and Jiang, Jun and Cheng, Ming-Ming and Gu, Jinwei and Loy, Chen Change},
  journal={arXiv:2104.10729},
  year={2021}
}

Contact Information

[email protected]

[email protected]
Owner
Chongyi Li
Chongyi Li
Incomplete easy-to-use math solver and PDF generator.

Math Expert Let me do your work Preview preview.mp4 Introduction Math Expert is our (@salastro, @younis-tarek, @marawn-mogeb) math high school graduat

SalahDin Ahmed 22 Jul 11, 2022
Repository for benchmarking graph neural networks

Benchmarking Graph Neural Networks Updates Nov 2, 2020 Project based on DGL 0.4.2. See the relevant dependencies defined in the environment yml files

NTU Graph Deep Learning Lab 2k Jan 03, 2023
Official implementation of "Towards Good Practices for Efficiently Annotating Large-Scale Image Classification Datasets" (CVPR2021)

Towards Good Practices for Efficiently Annotating Large-Scale Image Classification Datasets This is the official implementation of "Towards Good Pract

Sanja Fidler's Lab 52 Nov 22, 2022
Simple API for UCI Machine Learning Dataset Repository (search, download, analyze)

A simple API for working with University of California, Irvine (UCI) Machine Learning (ML) repository Table of Contents Introduction About Page of the

Tirthajyoti Sarkar 223 Dec 05, 2022
Library for machine learning stacking generalization.

stacked_generalization Implemented machine learning *stacking technic[1]* as handy library in Python. Feature weighted linear stacking is also availab

114 Jul 19, 2022
The repository contain code for building compiler using puthon.

Building Compiler This is a python implementation of JamieBuild's "Super Tiny Compiler" Overview JamieBuilds developed a wonderfully educative compile

Shyam Das Shrestha 1 Nov 21, 2021
Learnable Multi-level Frequency Decomposition and Hierarchical Attention Mechanism for Generalized Face Presentation Attack Detection

LMFD-PAD Note This is the official repository of the paper: LMFD-PAD: Learnable Multi-level Frequency Decomposition and Hierarchical Attention Mechani

28 Dec 02, 2022
Implementation of Learning Gradient Fields for Molecular Conformation Generation (ICML 2021).

[PDF] | [Slides] The official implementation of Learning Gradient Fields for Molecular Conformation Generation (ICML 2021 Long talk) Installation Inst

MilaGraph 117 Dec 09, 2022
AWS documentation corpus for zero-shot open-book question answering.

aws-documentation We present the AWS documentation corpus, an open-book QA dataset, which contains 25,175 documents along with 100 matched questions a

Sia Gholami 2 Jul 07, 2022
Subnet Replacement Attack: Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networks

Subnet Replacement Attack: Towards Practical Deployment-Stage Backdoor Attack on Deep Neural Networks Official implementation of paper Towards Practic

Xiangyu Qi 8 Dec 30, 2022
Explaining Deep Neural Networks - A comparison of different CAM methods based on an insect data set

Explaining Deep Neural Networks - A comparison of different CAM methods based on an insect data set This is the repository for the Deep Learning proje

Robert Krug 3 Feb 06, 2022
使用深度学习框架提取视频硬字幕;docker容器免安装深度学习库,使用本地api接口使得界面和后端识别分离;

extract-video-subtittle 使用深度学习框架提取视频硬字幕; 本地识别无需联网; CPU识别速度可观; 容器提供API接口; 运行环境 本项目运行环境非常好搭建,我做好了docker容器免安装各种深度学习包; 提供windows界面操作; 容器为CPU版本; 视频演示 https

歌者 16 Aug 06, 2022
[CVPR 2021] Released code for Counterfactual Zero-Shot and Open-Set Visual Recognition

Counterfactual Zero-Shot and Open-Set Visual Recognition This project provides implementations for our CVPR 2021 paper Counterfactual Zero-S

144 Dec 24, 2022
Official implementation of "Articulation Aware Canonical Surface Mapping"

Articulation-Aware Canonical Surface Mapping Nilesh Kulkarni, Abhinav Gupta, David F. Fouhey, Shubham Tulsiani Paper Project Page Requirements Python

Nilesh Kulkarni 56 Dec 16, 2022
Deep Learning Package based on TensorFlow

White-Box-Layer is a Python module for deep learning built on top of TensorFlow and is distributed under the MIT license. The project was started in M

YeongHyeon Park 7 Dec 27, 2021
Self-Supervised Monocular DepthEstimation with Internal Feature Fusion(arXiv), BMVC2021

DIFFNet This repo is for Self-Supervised Monocular Depth Estimation with Internal Feature Fusion(arXiv), BMVC2021 A new backbone for self-supervised d

Hang 94 Dec 25, 2022
Official Pytorch implementation of "Unbiased Classification Through Bias-Contrastive and Bias-Balanced Learning (NeurIPS 2021)

Unbiased Classification Through Bias-Contrastive and Bias-Balanced Learning (NeurIPS 2021) Official Pytorch implementation of Unbiased Classification

Youngkyu 17 Jan 01, 2023
Python wrappers to the C++ library SymEngine, a fast C++ symbolic manipulation library.

SymEngine Python Wrappers Python wrappers to the C++ library SymEngine, a fast C++ symbolic manipulation library. Installation Pip See License section

136 Dec 28, 2022
Trajectory Variational Autoencder baseline for Multi-Agent Behavior challenge 2022

MABe_2022_TVAE: a Trajectory Variational Autoencoder baseline for the 2022 Multi-Agent Behavior challenge This repository contains jupyter notebooks t

Andrew Ulmer 15 Nov 08, 2022
PyTorch implementation of SIFT descriptor

This is an differentiable pytorch implementation of SIFT patch descriptor. It is very slow for describing one patch, but quite fast for batch. It can

Dmytro Mishkin 150 Dec 24, 2022