Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Last update: Dec 10, 2022

Related tags

Overview

AdvRush

Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Environmental Set-up

Python == 3.6.12, PyTorch == 1.2.0, torchvision == 0.4.0

AdvRush Search Process

cd advrush && python train_search.py --batch_size 32 --gpu 0 --epochs 60 --a_gamma 0.01 --a_warmup_epochs 0 --w_warmup_epochs 60 --loss_hessian loss_cure

Adversarial Training

cd advrush && python adv_train.py --batch_size 64 --gpu 0 --epochs 200 --adv_loss pgd --arch ADVRUSH

Evaluation under PGD Attack

Prior to the evaluation process, add all necessary checkpoint files (preferably in the form of .pth.tar) to the /eval/checkpoints folder. To conduct white-box attacks,

cd eval &&
python pgd_attack.py --white-box-attack True --test-batch-size 10 --arch [arch_name] --checkpoint [./checkpoints/file_name.pth.tar] --data_type [cifar10/svhn]

To conduct black-box attacks,

cd eval &&
python pgd_attack.py --test-batch-size 10 --target_arch [target_arch] --target_checkpoint [./checkpoints/target_file.pth.tar] --source_arch [source_arch] --source_checkpoint [./checkpoints/source_file.pth.tar] --data_type cifar10

References

DARTS: Differentiable Architecture Search [ICLR '19] code paper

Robustness via Curvature Regularization, and Vice Versa [CVPR '19] code paper

Tradeoff-inspired Adversarial Defense via Surrogate-loss Minimization [ICML '19] code paper

Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Related tags

Overview

AdvRush

Environmental Set-up

AdvRush Search Process

Adversarial Training

Evaluation under PGD Attack

References

Owner

PyTorch implementation of some learning rate schedulers for deep learning researcher.

Code for Fold2Seq paper from ICML 2021

RDA: Robust Domain Adaptation via Fourier Adversarial Attacking

An efficient and easy-to-use deep learning model compression framework

Bonnet: An Open-Source Training and Deployment Framework for Semantic Segmentation in Robotics.

Code for our paper: Online Variational Filtering and Parameter Learning

PyTorch code for the ICCV'21 paper: "Always Be Dreaming: A New Approach for Class-Incremental Learning"

PyArmadillo: an alternative approach to linear algebra in Python

Fusion-in-Decoder Distilling Knowledge from Reader to Retriever for Question Answering

Multi-task head pose estimation in-the-wild

Architecture Patterns with Python (TDD, DDD, EDM)

LogAvgExp - Pytorch Implementation of LogAvgExp

An interactive DNN Model deployed on web that predicts the chance of heart failure for a patient with an accuracy of 98%

A simple configurable bot for sending arXiv article alert by mail

Simple Tensorflow implementation of Toward Spatially Unbiased Generative Models (ICCV 2021)

Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentation (CVPR 2021)

Code repository for the paper Computer Vision User Entity Behavior Analytics

Code for NeurIPS 2021 paper: Invariant Causal Imitation Learning for Generalizable Policies

Multiple style transfer via variational autoencoder

🐤 Nix-TTS: An Incredibly Lightweight End-to-End Text-to-Speech Model via Non End-to-End Distillation