Code release for General Greedy De-bias Learning

Last update: Mar 15, 2022

Related tags

Overview

General Greedy De-bias for Dataset Biases

This is an extention of "Greedy Gradient Ensemble for Robust Visual Question Answering" (ICCV 2021, Oral). The prerequisites can refer to GGE.

If you find this repo helpful, please cite

@article{han2021general,
	title={General Greedy De-bias Learning},
	author={Han, Xinzhe and Wang, Shuhui and Su, Chi and Huang, Qingming and Tian, Qi},
	journal={arXiv preprint arXiv:2112.10572 },
	year={2021}
}

@inproceedings{han2021greedy,
  title={Greedy gradient ensemble for robust visual question answering},
  author={Han, Xinzhe and Wang, Shuhui and Su, Chi and Huang, Qingming and Tian, Qi},
  booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
  pages={1584--1593},
  year={2021}
}

GGD

The core of GGD is to decompose the CE loss of GGE. The pytorch implementation is

loss = -(logits.log_softmax(-1) * labels).mean() + weight * (logits.log_softmax(-1) * bias * labels).mean()

Biased-MNIST

Biased-MNIST is produced the same with Re-bias. Run the notebook in the MNIST folder. Modify data_label_correlation for different bias level.

VQA-CP

Codes for VQA-CP is updated in GGE. To train a model with new GGD-CR, set import base_model_sfce in mian.py and run

CUDA_VISIBLE_DEVICES=0 python main.py --dataset cpv2 --mode gge_iter --debias ce_decompose --topq 1 --topv -1 --qvp 5 --output []

Adversarial SQuAD

The experiment for AdQA is provided in squad folder. The code is modified from squad.

Acknowledgements

Some codes are modified from CSS, UpDn, squad, and Re-bias. Thanks for their open source.

Code release for General Greedy De-bias Learning

Related tags

Overview

General Greedy De-bias for Dataset Biases

GGD

Biased-MNIST

VQA-CP

Adversarial SQuAD

Acknowledgements

Owner

Implementation of "Learning to Match Features with Seeded Graph Matching Network" ICCV2021

Generating synthetic mobility data for a realistic population with RNNs to improve utility and privacy

Offical code for the paper: "Growing 3D Artefacts and Functional Machines with Neural Cellular Automata" https://arxiv.org/abs/2103.08737

A style-based Quantum Generative Adversarial Network

TensorFlow implementation of "Variational Inference with Normalizing Flows"

Off-policy continuous control in PyTorch, with RDPG, RTD3 & RSAC

A modification of Daniel Russell's notebook merged with Katherine Crowson's hq-skip-net changes

Vision transformers (ViTs) have found only limited practical use in processing images

Pytorch implementation of NEGEV method. Paper: "Negative Evidence Matters in Interpretable Histology Image Classification".

Translation-equivariant Image Quantizer for Bi-directional Image-Text Generation

Code release for Local Light Field Fusion at SIGGRAPH 2019

Pca-on-genotypes - Mini bioinformatics project - PCA on genotypes

The official implementation of NeurIPS 2021 paper: Finding Optimal Tangent Points for Reducing Distortions of Hard-label Attacks

MoCap-Solver: A Neural Solver for Optical Motion Capture Data

This is the official pytorch implementation for the paper: Instance Similarity Learning for Unsupervised Feature Representation.

Code for "Intra-hour Photovoltaic Generation Forecasting based on Multi-source Data and Deep Learning Methods."

Tutorial page of the Climate Hack, the greatest hackathon ever

Pytorch Implementation of "Contrastive Representation Learning for Exemplar-Guided Paraphrase Generation"

A python package for generating, analyzing and visualizing building shadows

MlTr: Multi-label Classification with Transformer