Jacobian-Free Backprop

Associated Publication

JFB: Jacobian-Free Backpropagation for Implicit Models (arXiv Link)

@article{WuFung2022JFB,
    title={JFB: Jacobian-Free Backpropagation for Implicit Models},
    author={Fung, Samy Wu and Heaton, Howard and Li, Qiuwei and McKenzie, Daniel and Osher, Stanley and Yin, Wotao},
    journal={Proceedings of the AAAI Conference on Artificial Intelligence},
    year={2022}
}

Set-up

Install all the requirements:

pip install -r requirements.txt

Training

For each dataset, there are three types of training drivers:

FPN with our proposed backprop:

	python train_CIFAR10.py
	python train_CIFAR10_Unaugmented.py
	python train_MNIST.py
	python train_SVHN.py

FPN with Jacobian-based backprop:

	python train_CIFAR10_Jacobian_Based.py
	python train_CIFAR10_Unaugmented_Jacobian_Based.py
	python train_MNIST_Jacobian_Based.py
	python train_SVHN_Jacobian_Based.py

Explicit models.

	python train_CIFAR10_Explicit.py
	python train_CIFAR10_Unaugmented_Explicit.py
	python train_MNIST_Explicit.py
	python train_SVHN_Explicit.py

JFB: Jacobian-Free Backpropagation for Implicit Models

Related tags

Overview

Jacobian-Free Backprop

Associated Publication

Set-up

Training

Owner

Typal Research

A demonstration of using a live Tensorflow session to create an interactive face-GAN explorer.

DanceTrack: Multiple Object Tracking in Uniform Appearance and Diverse Motion

Towards uncontrained hand-object reconstruction from RGB videos

Audio Domain Adaptation for Acoustic Scene Classification using Disentanglement Learning

Revitalizing CNN Attention via Transformers in Self-Supervised Visual Representation Learning

Event-forecasting - Event Forecasting Algorithms With Python

TLDR: Twin Learning for Dimensionality Reduction

This is the implementation of "SELF SUPERVISED REPRESENTATION LEARNING WITH DEEP CLUSTERING FOR ACOUSTIC UNIT DISCOVERY FROM RAW SPEECH" submitted to ICASSP 2022

Axel - 3D printed robotic hands and they controll with Raspberry Pi and Arduino combo

Alfred-Restore-Iterm-Arrangement - An Alfred workflow to restore iTerm2 window Arrangements

CVPR2022 paper "Dense Learning based Semi-Supervised Object Detection"

ML model to classify between cats and dogs

Source code for our EMNLP'21 paper 《Raise a Child in Large Language Model: Towards Effective and Generalizable Fine-tuning》

Garbage classification using structure data.

FlowTorch is a PyTorch library for learning and sampling from complex probability distributions using a class of methods called Normalizing Flows

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"

Session-based Recommendation, CoHHN, price preferences, interest preferences, Heterogeneous Hypergraph, Co-guided Learning, SIGIR2022

Reinfore learning tool box, contains trpo, a3c algorithm for continous action space

SAMO: Streaming Architecture Mapping Optimisation

Large-scale open domain KNOwledge grounded conVERsation system based on PaddlePaddle