code for generating data set ES-ImageNet with corresponding training code

Last update: Dec 25, 2022

Overview

es-imagenet-master

code for generating data set ES-ImageNet with corresponding training code

dataset generator

some codes of ODG algorithm
The variables to be modified include datapath (data storage path after transformation, which needs to be created before transformation) and root_Path (root directory of training set before transformation)

file name	function
traconvert.py	converting training set of ISLVRC 2012 into event stream using ODG
trainlabel_dir.txt	It stores the corresponding relationship between the class name and label of the original Imagenet file
trainlabel.txt	It is generated during transformation and stores the label of training set
valconvert.py	Transformation code for test set.
valorigin.txt	Original test label, need and valconvert.py Put it in the same folder
vallabel.txt	It is generated during transformation and stores the label of training set.

dataset usage

codes are in ./datasets
some traing examples are provided for ES-imagenet in ./example An example code for easily using this dataset based on Pytorch

from __future__ import print_function
import sys
sys.path.append("..")
from datasets.es_imagenet_new import ESImagenet_Dataset
import torch.nn as nn
import torch

data_path = None #TODO:modify 
train_dataset = ESImagenet_Dataset(mode='train',data_set_path=data_path)
test_dataset = ESImagenet_Dataset(mode='test',data_set_path=data_path)

train_sampler = torch.utils.data.distributed.DistributedSampler(train_dataset)
test_sampler  = torch.utils.data.distributed.DistributedSampler(test_dataset)
train_loader = torch.utils.data.DataLoader(train_dataset, batch_size=batch_size, shuffle=False, num_workers=1,pin_memory=True,drop_last=True,sampler=train_sampler)
test_loader = torch.utils.data.DataLoader(test_dataset, batch_size=batch_size, shuffle=False, num_workers=1,pin_memory=True)

for batch_idx, (inputs, targets) in enumerate(train_loader)
  pass
  # input = [batchsize,time,channel,width,height]
  
for batch_idx, (inputs, targets) in enumerate(test_loader):
  pass
  # input = [batchsize,time,channel,width,height]

training example and benchmarks

Requirements

Python >= 3.5
Pytorch >= 1.7
CUDA >=10.0
TenosrBoradX(optional)

Train the baseline models

$ cd example

$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -m torch.distributed.launch --nproc_per_node=4 example_ES_res18.py #LIAF/LIF-ResNet-18
$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -m torch.distributed.launch --nproc_per_node=4 example_ES_res34.py #LIAF/LIF-ResNet-34
$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -m torch.distributed.launch --nproc_per_node=4 compare_ES_3DCNN34.py #3DCNN-ResNet-34
$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -m torch.distributed.launch --nproc_per_node=4 compare_ES_3DCNN18.py #3DCNN-ResNet-18
$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -m torch.distributed.launch --nproc_per_node=4 compare_ES_2DCNN34.py #2DCNN-ResNet-34 
$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -m torch.distributed.launch --nproc_per_node=4 compare_ES_2DCNN18.py #2DCNN-ResNet-18
$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -m torch.distributed.launch --nproc_per_node=4 compare_CONVLSTM.py #ConvLSTM (no used in paper)
$ CUDA_VISIBLE_DEVICES=0,1,2,3 python -m torch.distributed.launch --nproc_per_node=4 example_ES_res50.py #LIAF/LIF-ResNet-50 (no used in paper)

** note:** To select LIF mode, change the config files under /LIAFnet : self.actFun= torch.nn.LeakyReLU(0.2, inplace=False) #nexttest:selu to self.actFun= LIAF.LIFactFun.apply

baseline / Benchmark

Network	layer	Type Test Acc/%	# of Para	FP32+/GFLOPs	FP32x/GFLOPs
ResNet18	2D-CNN	41.030	11.68M	1.575	1.770
ResNet18	3D-CNN	38.050	28.56M	12.082	12.493
ResNet18	LIF	39.894	11.69M	12.668	0.269
ResNet18	LIAF	42.544	11.69M	12.668	14.159
ResNet34	2D-CNN	42.736	21.79M	3.211	3.611
ResNet34	3D-CNN	39.410	48.22M	20.671	21.411
ResNet34	LIF	43.424	21.80M	25.783	0.288
ResNet18+imagenet-pretrain (a)	LIF	43.74	11.69M	12.668	0.269
ResNet34	LIAF	47.466	21.80M	25.783	28.901
ResNet18+self-pretrain	LIAF	50.54	11.69M	12.668	14.159
ResNet18+imagenet-pretrain (b)	LIAF	52.25	11.69M	12.668	14.159
ResNet34+imagenet-pretrain (c)	LIAF	51.83	21.80M	25.783	28.901

Note: model (a), (b) and (c) are stored in ./pretrained_model

Download

The datasets ES-ImageNet (100GB) for this study can be download in the Tsinghua Cloud or Openl
The converted event-frame version (40GB) can be found in Tsinghua Cloud

Citation

If you use this for research, please cite. Here is an example BibTeX entry:

@misc{lin2021esimagenet,
    title={ES-ImageNet: A Million Event-Stream Classification Dataset for Spiking Neural Networks},
    author={Yihan Lin and Wei Ding and Shaohua Qiang and Lei Deng and Guoqi Li},
    year={2021},
    eprint={2110.12211},
    archivePrefix={arXiv},
    primaryClass={cs.CV}
}

You might also like...

Code for the paper "A Study of Face Obfuscation in ImageNet"

A Study of Face Obfuscation in ImageNet Code for the paper: A Study of Face Obfuscation in ImageNet Kaiyu Yang, Jacqueline Yau, Li Fei-Fei, Jia Deng,

35 Oct 4, 2022

Code for Active Learning at The ImageNet Scale.

Code for Active Learning at The ImageNet Scale. This repository implements many popular active learning algorithms and allows training with torch's DDP.

47 Dec 12, 2022

[ICLR 2021] "Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective" by Wuyang Chen, Xinyu Gong, Zhangyang Wang

Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective [PDF] Wuyang Chen, Xinyu Gong, Zhangyang Wang In ICLR 2

156 Nov 28, 2022

A PyTorch re-implementation of the paper 'Exploring Simple Siamese Representation Learning'. Reproduced the 67.8% Top1 Acc on ImageNet.

Exploring simple siamese representation learning This is a PyTorch re-implementation of the SimSiam paper on ImageNet dataset. The results match that

72 Nov 9, 2022

(ImageNet pretrained models) The official pytorch implemention of the TPAMI paper "Res2Net: A New Multi-scale Backbone Architecture"

Res2Net The official pytorch implemention of the paper "Res2Net: A New Multi-scale Backbone Architecture" Our paper is accepted by IEEE Transactions o

928 Dec 29, 2022

Attack classification models with transferability, black-box attack; unrestricted adversarial attacks on imagenet

Comments

Cannot find validation dataset

Hello,

Thanks for the open-sourced code. However, I had trouble finding the validation set. I directly download the frame set in your cloud server. However, I direct uncompress the file and I didn't find the validation dataset. Also, your dataset_generator/vallabel.txt is empty. How can I find the validation index file and the dataset?

Thanks.

opened by yhhhli 4

Releases(1.1.0)

1.1.0(Oct 25, 2022)

Source code(tar.gz)
Source code(zip)
1.0.0(Mar 2, 2021)

Generating codes, dataset utils and baseline models with training codes
Source code(tar.gz)
Source code(zip)

code for generating data set ES-ImageNet with corresponding training code

Related tags

Overview

es-imagenet-master

dataset generator

dataset usage

training example and benchmarks

Requirements

Train the baseline models

baseline / Benchmark

Download

Citation

You might also like...

Code for the paper "A Study of Face Obfuscation in ImageNet"

Code for Active Learning at The ImageNet Scale.

[ICLR 2021] "Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective" by Wuyang Chen, Xinyu Gong, Zhangyang Wang

A PyTorch re-implementation of the paper 'Exploring Simple Siamese Representation Learning'. Reproduced the 67.8% Top1 Acc on ImageNet.

(ImageNet pretrained models) The official pytorch implemention of the TPAMI paper "Res2Net: A New Multi-scale Backbone Architecture"

Attack classification models with transferability, black-box attack; unrestricted adversarial attacks on imagenet

transfer attack; adversarial examples; black-box attack; unrestricted Adversarial Attacks on ImageNet; CVPR2021 天池黑盒竞赛

Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(2021) paper

A small demonstration of using WebDataset with ImageNet and PyTorch Lightning

Comments

Cannot find validation dataset

Releases(1.1.0)

1.1.0(Oct 25, 2022)

1.0.0(Mar 2, 2021)

Owner

Ordinarabbit

Oriented Response Networks, in CVPR 2017

Implicit Deep Adaptive Design (iDAD)

Code for Towards Unifying Behavioral and Response Diversity for Open-ended Learning in Zero-sum Games

DiAne is a smart fuzzer for IoT devices

Label Studio is a multi-type data labeling and annotation tool with standardized output format

ANEA: Distant Supervision for Low-Resource Named Entity Recognition

This repo is a C++ version of yolov5_deepsort_tensorrt. Packing all C++ programs into .so files, using Python script to call C++ programs further.

Fully convolutional deep neural network to remove transparent overlays from images

Instance-wise Occlusion and Depth Orders in Natural Scenes (CVPR 2022)

A Multi-attribute Controllable Generative Model for Histopathology Image Synthesis

Implementations of the algorithms in the paper Approximative Algorithms for Multi-Marginal Optimal Transport and Free-Support Wasserstein Barycenters

NeuroGen: activation optimized image synthesis for discovery neuroscience

Repo for "Event-Stream Representation for Human Gaits Identification Using Deep Neural Networks"

Adaptive Attention Span for Reinforcement Learning

Face Transformer for Recognition

A Python script that creates subtitles of a given length from text paragraphs that can be easily imported into any Video Editing software such as FinalCut Pro for further adjustments.

This is the official PyTorch implementation for "Mesa: A Memory-saving Training Framework for Transformers".

Adapter-BERT: Parameter-Efficient Transfer Learning for NLP.

Efficient-GlobalPointer - Pytorch Efficient GlobalPointer

Apollo optimizer in tensorflow