Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Last update: Dec 10, 2022

Related tags

Overview

AdvRush

Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Environmental Set-up

Python == 3.6.12, PyTorch == 1.2.0, torchvision == 0.4.0

AdvRush Search Process

cd advrush && python train_search.py --batch_size 32 --gpu 0 --epochs 60 --a_gamma 0.01 --a_warmup_epochs 0 --w_warmup_epochs 60 --loss_hessian loss_cure

Adversarial Training

cd advrush && python adv_train.py --batch_size 64 --gpu 0 --epochs 200 --adv_loss pgd --arch ADVRUSH

Evaluation under PGD Attack

Prior to the evaluation process, add all necessary checkpoint files (preferably in the form of .pth.tar) to the /eval/checkpoints folder. To conduct white-box attacks,

cd eval &&
python pgd_attack.py --white-box-attack True --test-batch-size 10 --arch [arch_name] --checkpoint [./checkpoints/file_name.pth.tar] --data_type [cifar10/svhn]

To conduct black-box attacks,

cd eval &&
python pgd_attack.py --test-batch-size 10 --target_arch [target_arch] --target_checkpoint [./checkpoints/target_file.pth.tar] --source_arch [source_arch] --source_checkpoint [./checkpoints/source_file.pth.tar] --data_type cifar10

References

DARTS: Differentiable Architecture Search [ICLR '19] code paper

Robustness via Curvature Regularization, and Vice Versa [CVPR '19] code paper

Tradeoff-inspired Adversarial Defense via Surrogate-loss Minimization [ICML '19] code paper

Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Related tags

Overview

AdvRush

Environmental Set-up

AdvRush Search Process

Adversarial Training

Evaluation under PGD Attack

References

Owner

PyTorch code for EMNLP 2021 paper: Don't be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialogue System

A Free and Open Source Python Library for Multiobjective Optimization

A resource for learning about deep learning techniques from regression to LSTM and Reinforcement Learning using financial data and the fitness functions of algorithmic trading

Improving Non-autoregressive Generation with Mixup Training

Source code for Task-Aware Variational Adversarial Active Learning

Unofficial PyTorch implementation of TokenLearner by Google AI

[ACL-IJCNLP 2021] Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning

[CVPR 2021] Pytorch implementation of Hijack-GAN: Unintended-Use of Pretrained, Black-Box GANs

BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignment

Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.

PaddleRobotics is an open-source algorithm library for robots based on Paddle, including open-source parts such as human-robot interaction, complex motion control, environment perception, SLAM positioning, and navigation.

[NeurIPS 2021] A weak-shot object detection approach by transferring semantic similarity and mask prior.

Source Code for our paper: Understand me, if you refer to Aspect Knowledge: Knowledge-aware Gated Recurrent Memory Network

Unsupervised Learning of Video Representations using LSTMs

NuPIC Studio is an all-in-one tool that allows users create a HTM neural network from scratch

Official PyTorch Implementation of HELP: Hardware-adaptive Efficient Latency Prediction for NAS via Meta-Learning (NeurIPS 2021 Spotlight)

PiRapGenerator - Make anyone rap the digits of pi

A Haskell kernel for IPython.

Patch SVDD for Image anomaly detection

Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Related tags

Overview

AdvRush

Environmental Set-up

AdvRush Search Process

Adversarial Training

Evaluation under PGD Attack

References

Owner

PyTorch code for EMNLP 2021 paper: Don't be Contradicted with Anything! CI-ToD: Towards Benchmarking Consistency for Task-oriented Dialogue System

A Free and Open Source Python Library for Multiobjective Optimization

A resource for learning about deep learning techniques from regression to LSTM and Reinforcement Learning using financial data and the fitness functions of algorithmic trading

Improving Non-autoregressive Generation with Mixup Training

Source code for Task-Aware Variational Adversarial Active Learning

Unofficial PyTorch implementation of TokenLearner by Google AI

[ACL-IJCNLP 2021] Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning

[CVPR 2021] Pytorch implementation of Hijack-GAN: Unintended-Use of Pretrained, Black-Box GANs

BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignment

Load What You Need: Smaller Multilingual Transformers for Pytorch and TensorFlow 2.0.

PaddleRobotics is an open-source algorithm library for robots based on Paddle, including open-source parts such as human-robot interaction, complex motion control, environment perception, SLAM positioning, and navigation.

[NeurIPS 2021] A weak-shot object detection approach by transferring semantic similarity and mask prior.

Source Code for our paper: Understand me, if you refer to Aspect Knowledge: Knowledge-aware Gated Recurrent Memory Network

Unsupervised Learning of Video Representations using LSTMs

NuPIC Studio is an all­-in-­one tool that allows users create a HTM neural network from scratch

Official PyTorch Implementation of HELP: Hardware-adaptive Efficient Latency Prediction for NAS via Meta-Learning (NeurIPS 2021 Spotlight)

PiRapGenerator - Make anyone rap the digits of pi

A Haskell kernel for IPython.

Patch SVDD for Image anomaly detection

NuPIC Studio is an all-in-one tool that allows users create a HTM neural network from scratch