Implementation of TransGanFormer, an all-attention GAN that combines the finding from the recent GanFormer and TransGan paper

Last update: Dec 06, 2022

Overview

TransGanFormer (wip)

Implementation of TransGanFormer, an all-attention GAN that combines the finding from the recent GansFormer and TransGan paper. It will also contain a bunch of tricks I have picked up building transformers and GANs for the last year or so, including efficient linear attention and pixel level attention.

Install

$ pip install transganformer

Usage

$ transganformer --data ./path/to/data

Citations

@misc{jiang2021transgan,
    title   = {TransGAN: Two Transformers Can Make One Strong GAN}, 
    author  = {Yifan Jiang and Shiyu Chang and Zhangyang Wang},
    year    = {2021},
    eprint  = {2102.07074},
    archivePrefix = {arXiv},
    primaryClass = {cs.CV}
}

@misc{hudson2021generative,
    title   = {Generative Adversarial Transformers}, 
    author  = {Drew A. Hudson and C. Lawrence Zitnick},
    year    = {2021},
    eprint  = {2103.01209},
    archivePrefix = {arXiv},
    primaryClass = {cs.CV}
}

You might also like...

Finding all things on-prem Microsoft for password spraying and enumeration.

msprobe About Installing Usage Examples Coming Soon Acknowledgements About Finding all things on-prem Microsoft for password spraying and enumeration.

205 Jan 9, 2023

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones

HaloNet - Pytorch Implementation of the Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones. This re

189 Nov 22, 2022

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"

Memory Efficient Attention Pytorch Implementation of a memory efficient multi-head attention as proposed in the paper, Self-attention Does Not Need O(

180 Jan 5, 2023

Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deformable Attention"

Deformable Attention Implementation of Deformable Attention from this paper in Pytorch, which appears to be an improvement to what was proposed in DET

128 Dec 24, 2022

A curated (most recent) list of resources for Learning with Noisy Labels

321 Jan 9, 2023

The official implementation of NeurIPS 2021 paper: Finding Optimal Tangent Points for Reducing Distortions of Hard-label Attacks

11 Nov 27, 2022

The official pytorch implementation of our paper "Is Space-Time Attention All You Need for Video Understanding?"

TimeSformer This is an official pytorch implementation of Is Space-Time Attention All You Need for Video Understanding?. In this repository, we provid

1k Dec 31, 2022

Unofficial PyTorch implementation of Fastformer based on paper "Fastformer: Additive Attention Can Be All You Need"."

Fastformer-PyTorch Unofficial PyTorch implementation of Fastformer based on paper Fastformer: Additive Attention Can Be All You Need. Usage : import t

126 Dec 6, 2022

Unofficial Tensorflow-Keras implementation of Fastformer based on paper [Fastformer: Additive Attention Can Be All You Need](https://arxiv.org/abs/2108.09084).

Fastformer-Keras Unofficial Tensorflow-Keras implementation of Fastformer based on paper Fastformer: Additive Attention Can Be All You Need. Tensorflo

10 Jan 30, 2022

Comments

kmeans_iters in attention

Hello first at all thank you for taking the time and port all of theses models to pytorch, you are really helping out people like me who have tensorflow as a second language :D

in line 689 of https://github.com/dorarad/gansformer/blob/main/training/network.py there is a loop over kmeans-iter in the transformerlayer, but i can t find this loop in your implementation of Attention, is it implicitly implemented with these einops - i am sadly not fluent with einops or tensorflow :/

regards martin

opened by martinpflaum 0
dual_contrast_loss argument - error while training

When trying to train a model, the dual_contrast_loss argument spits up an error on lightweight-gan.py. My guess is that it's not implemented yet.

At first I thought it was a mismatch (should it be dual_contrastive_loss btw like in lightweight-gan?) but apparently needed to be commented out for training to start successfully.

Very exciting by the way! Training seems to be super fast, about 28h for 150,000 iterations for a 256p model on my 2080 (although it's a very small dataset). I'll share some closer-to-final results once I have them.

Best, Theodore.

opened by TheodoreGalanos 2

Releases(0.0.17)

0.0.17(Apr 27, 2021)

Source code(tar.gz)
Source code(zip)
0.0.16(Apr 15, 2021)

Source code(tar.gz)
Source code(zip)
0.0.15(Apr 13, 2021)

Source code(tar.gz)
Source code(zip)
0.0.14(Apr 13, 2021)

Source code(tar.gz)
Source code(zip)
0.0.12(Apr 12, 2021)

Source code(tar.gz)
Source code(zip)
0.0.11(Apr 12, 2021)

Source code(tar.gz)
Source code(zip)
0.0.10(Apr 11, 2021)

Source code(tar.gz)
Source code(zip)
0.0.9(Apr 11, 2021)

Source code(tar.gz)
Source code(zip)
0.0.8(Apr 11, 2021)

Source code(tar.gz)
Source code(zip)
0.0.7(Apr 9, 2021)

Source code(tar.gz)
Source code(zip)
0.0.6(Apr 9, 2021)

Source code(tar.gz)
Source code(zip)
0.0.5(Apr 9, 2021)

Source code(tar.gz)
Source code(zip)
0.0.4(Apr 7, 2021)

Source code(tar.gz)
Source code(zip)
0.0.3(Apr 7, 2021)

Source code(tar.gz)
Source code(zip)
0.0.2(Apr 5, 2021)

Source code(tar.gz)
Source code(zip)
0.0.1(Apr 5, 2021)

Source code(tar.gz)
Source code(zip)

Owner

Phil Wang

Working with Attention. It's all we need.

GitHub Repository

Pytorch implementation of One-Shot Affordance Detection

One-shot Affordance Detection PyTorch implementation of our one-shot affordance detection models. This repository contains PyTorch evaluation code, tr

46 Dec 12, 2022

A fast poisson image editing implementation that can utilize multi-core CPU or GPU to handle a high-resolution image input.

Poisson Image Editing - A Parallel Implementation Jiayi Weng (jiayiwen), Zixu Chen (zixuc) Poisson Image Editing is a technique that can fuse two imag

110 Dec 27, 2022

Reference code for the paper CAMS: Color-Aware Multi-Style Transfer.

CAMS: Color-Aware Multi-Style Transfer Mahmoud Afifi1, Abdullah Abuolaim*1, Mostafa Hussien*2, Marcus A. Brubaker1, Michael S. Brown1 1York University

36 Dec 04, 2022

A PyTorch implementation of DenseNet.

A PyTorch Implementation of DenseNet This is a PyTorch implementation of the DenseNet-BC architecture as described in the paper Densely Connected Conv

771 Dec 15, 2022

Picasso: A CUDA-based Library for Deep Learning over 3D Meshes

The Picasso Library is intended for complex real-world applications with large-scale surfaces, while it also performs impressively on the small-scale applications over synthetic shape manifolds. We h

97 Dec 01, 2022

Yggdrasil - A simplistic bot designed to streamline your server experience

Ygggdrasil A simplistic bot designed to streamline your server experience. Desig

1 Dec 14, 2022

Code of 3D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Faces

3D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Faces Installation After cloning the repo open

37 Dec 03, 2022

PAWS 🐾 Predicting View-Assignments with Support Samples

This repo provides a PyTorch implementation of PAWS (predicting view assignments with support samples), as described in the paper Semi-Supervised Learning of Visual Features by Non-Parametrically Pre

437 Dec 23, 2022

Flexible time series feature extraction & processing

tsflex is a toolkit for flexible time series processing & feature extraction, that is efficient and makes few assumptions about sequence data. Useful

206 Dec 28, 2022

Source Code for ICSE 2022 Paper - ``Can We Achieve Fairness Using Semi-Supervised Learning?''

Fair-SSL Source Code for ICSE 2022 Paper - Can We Achieve Fairness Using Semi-Supervised Learning? Ethical bias in machine learning models has become

1 Dec 18, 2021

Official code for ICCV2021 paper "M3D-VTON: A Monocular-to-3D Virtual Try-on Network"

M3D-VTON: A Monocular-to-3D Virtual Try-On Network Official code for ICCV2021 paper "M3D-VTON: A Monocular-to-3D Virtual Try-on Network" Paper | Suppl

109 Dec 29, 2022

This repository contains code used to audit the stability of personality predictions made by two algorithmic hiring systems

Stability Audit This repository contains code used to audit the stability of personality predictions made by two algorithmic hiring systems, Humantic

4 Oct 27, 2022

Implementation of TransGanFormer, an all-attention GAN that combines the finding from the recent GanFormer and TransGan paper

Related tags

Overview

TransGanFormer (wip)

Install

Usage

Citations

You might also like...

Finding all things on-prem Microsoft for password spraying and enumeration.

Implementation of the 😇 Attention layer from the paper, Scaling Local Self-Attention For Parameter Efficient Visual Backbones

Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"

Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deformable Attention"

A curated (most recent) list of resources for Learning with Noisy Labels

The official implementation of NeurIPS 2021 paper: Finding Optimal Tangent Points for Reducing Distortions of Hard-label Attacks

The official pytorch implementation of our paper "Is Space-Time Attention All You Need for Video Understanding?"

Unofficial PyTorch implementation of Fastformer based on paper "Fastformer: Additive Attention Can Be All You Need"."

Unofficial Tensorflow-Keras implementation of Fastformer based on paper [Fastformer: Additive Attention Can Be All You Need](https://arxiv.org/abs/2108.09084).

Comments

kmeans_iters in attention

dual_contrast_loss argument - error while training

Releases(0.0.17)

0.0.17(Apr 27, 2021)

0.0.16(Apr 15, 2021)

0.0.15(Apr 13, 2021)

0.0.14(Apr 13, 2021)

0.0.12(Apr 12, 2021)

0.0.11(Apr 12, 2021)

0.0.10(Apr 11, 2021)

0.0.9(Apr 11, 2021)

0.0.8(Apr 11, 2021)

0.0.7(Apr 9, 2021)

0.0.6(Apr 9, 2021)

0.0.5(Apr 9, 2021)

0.0.4(Apr 7, 2021)

0.0.3(Apr 7, 2021)

0.0.2(Apr 5, 2021)

0.0.1(Apr 5, 2021)

Owner

Phil Wang

Pytorch implementation of One-Shot Affordance Detection

A fast poisson image editing implementation that can utilize multi-core CPU or GPU to handle a high-resolution image input.

Reference code for the paper CAMS: Color-Aware Multi-Style Transfer.

A PyTorch implementation of DenseNet.

Picasso: A CUDA-based Library for Deep Learning over 3D Meshes

Yggdrasil - A simplistic bot designed to streamline your server experience

Code of 3D Shape Variational Autoencoder Latent Disentanglement via Mini-Batch Feature Swapping for Bodies and Faces

PAWS 🐾 Predicting View-Assignments with Support Samples

Flexible time series feature extraction & processing

Source Code for ICSE 2022 Paper - ``Can We Achieve Fairness Using Semi-Supervised Learning?''

Official code for ICCV2021 paper "M3D-VTON: A Monocular-to-3D Virtual Try-on Network"

This repository contains code used to audit the stability of personality predictions made by two algorithmic hiring systems

This repository contains the accompanying code for Deep Virtual Markers for Articulated 3D Shapes, ICCV'21

Open-CyKG: An Open Cyber Threat Intelligence Knowledge Graph

Cosine Annealing With Warmup

I-SECRET: Importance-guided fundus image enhancement via semi-supervised contrastive constraining

The first machine learning framework that encourages learning ML concepts instead of memorizing class functions.

Remote sensing change detection using PaddlePaddle

Rank1 Conversation Emotion Detection Task

Bayesian Optimization Library for Medical Image Segmentation.