Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Last update: Dec 10, 2022

Related tags

Overview

AdvRush

Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Environmental Set-up

Python == 3.6.12, PyTorch == 1.2.0, torchvision == 0.4.0

AdvRush Search Process

cd advrush && python train_search.py --batch_size 32 --gpu 0 --epochs 60 --a_gamma 0.01 --a_warmup_epochs 0 --w_warmup_epochs 60 --loss_hessian loss_cure

Adversarial Training

cd advrush && python adv_train.py --batch_size 64 --gpu 0 --epochs 200 --adv_loss pgd --arch ADVRUSH

Evaluation under PGD Attack

Prior to the evaluation process, add all necessary checkpoint files (preferably in the form of .pth.tar) to the /eval/checkpoints folder. To conduct white-box attacks,

cd eval &&
python pgd_attack.py --white-box-attack True --test-batch-size 10 --arch [arch_name] --checkpoint [./checkpoints/file_name.pth.tar] --data_type [cifar10/svhn]

To conduct black-box attacks,

cd eval &&
python pgd_attack.py --test-batch-size 10 --target_arch [target_arch] --target_checkpoint [./checkpoints/target_file.pth.tar] --source_arch [source_arch] --source_checkpoint [./checkpoints/source_file.pth.tar] --data_type cifar10

References

DARTS: Differentiable Architecture Search [ICLR '19] code paper

Robustness via Curvature Regularization, and Vice Versa [CVPR '19] code paper

Tradeoff-inspired Adversarial Defense via Surrogate-loss Minimization [ICML '19] code paper

Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Related tags

Overview

AdvRush

Environmental Set-up

AdvRush Search Process

Adversarial Training

Evaluation under PGD Attack

References

Owner

Lucid Sonic Dreams syncs GAN-generated visuals to music.

Time-stretch audio clips quickly with PyTorch (CUDA supported)! Additional utilities for searching efficient transformations are included.

A benchmark dataset for emulating atmospheric radiative transfer in weather and climate models with machine learning (NeurIPS 2021 Datasets and Benchmarks Track)

This is a simple backtesting framework to help you test your crypto currency trading. It includes a way to download and store historical crypto data and to execute a trading strategy.

Code for the paper: On Pathologies in KL-Regularized Reinforcement Learning from Expert Demonstrations

[ICCV 2021] Focal Frequency Loss for Image Reconstruction and Synthesis

On the Complementarity between Pre-Training and Back-Translation for Neural Machine Translation (Findings of EMNLP 2021))

Neuralnetwork - Basic Multilayer Perceptron Neural Network for deep learning

Learning Representational Invariances for Data-Efficient Action Recognition

Code for MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks

A python toolbox for predictive uncertainty quantification, calibration, metrics, and visualization

A DCGAN to generate anime faces using custom mined dataset

PyTorch implementation of SampleRNN: An Unconditional End-to-End Neural Audio Generation Model

Code for "3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop"

Code for "Long Range Probabilistic Forecasting in Time-Series using High Order Statistics"

A keras implementation of ENet (abandoned for the foreseeable future)

YOLOV4运行在嵌入式设备上

Efficiently computes derivatives of numpy code.

Official PyTorch implementation of the paper "Self-Supervised Relational Reasoning for Representation Learning", NeurIPS 2020 Spotlight.