Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

Last update: Dec 12, 2022

Related tags

Deep Learning SODEF

Overview

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attackss.

Qiyu Kang, Yang Song, Qinxu Ding, Wee Peng Tay

Environment settings

OS: Ubuntu 18.04
GPU: RTX 2080 Ti, RTX a5000, RTX 3090
Cuda: 11.1 or 10.2
Python: >=3.6
PyTorch: >= 1.6.0
Torchvision: >= 0.7.0

Empirical Evaluations

Compatibility of SODEF

In this section, we show compatibility of SODEF using TRADES:

We append our SODEF after TRADES net to improve the model robustness against adversarial attacks. TRADES works as the feature extractor $h_{\boldsymbol{\phi}}$ as in our paper. Please note TRADES weights are kept fixed during the training. We use the pretrained model provided by TRADES Repo.

Attack / Model	TRADES ℒ_∞	TRADES+SODEF ℒ_∞	TRADES ℒ₂	TRADES+SODEF ℒ₂
Clean	85.48	85.18	85.48	85.18
APGD_CE	56.08	70.90	61.74	74.35
APGD_DLR^T	53.70	64.15	59.22	68.55
FAB^T	54.18	82.92	60.31	83.15
Square	59.12	62.21	72.65	76.02
AutoAttack	53.69	57.76	59.42	67.75

Tab 1. Classification accuracy (%) using TRADES (w/ and w/o SODEF) under AutoAttack on adversarial CIFAR10 examples with ℒ₂ norm (ϵ = 0.5) and ℒ_∞ norm (ϵ = 8/255).

Transfer attack:

Classification accuracy for adv examples generated from original pretrained model using AA ℒ_∞ (ϵ = 8/255) attacks : 61.94%.

cd trades_r
python sodef_eval_ode.py

cd trades_r
sodef_eval_transfer.ipynb

Notification

More test code and models will be uploaded soon after packing.

We currenly only upload the test code for SODEF. Please understand we have strict protocols for code release as this research is partially funded by corporate funding. We will upload the training code as soon as permission is granted.

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

Related tags

Overview

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

Environment settings

Empirical Evaluations

Compatibility of SODEF

In this section, we show compatibility of SODEF using TRADES:

Notification

Owner

Kang Qiyu

NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations

StarGAN - Official PyTorch Implementation (CVPR 2018)

Can we do Customers Segmentation using PHP and Unsupervized Machine Learning ? Yes we can ! 🤡

Molecular AutoEncoder in PyTorch

Deep Learning tutorials in jupyter notebooks.

Python code to fuse multiple RGB-D images into a TSDF voxel volume.

PixelPick This is an official implementation of the paper "All you need are a few pixels: semantic segmentation with PixelPick."

Relative Uncertainty Learning for Facial Expression Recognition

RL-driven agent playing tic-tac-toe on starknet against challengers.

In this project, two programs can help you take full agvantage of time on the model training with a remote server

Tensorflow Implementation of the paper "Spectral Normalization for Generative Adversarial Networks" (ICML 2017 workshop)

Scalable Attentive Sentence-Pair Modeling via Distilled Sentence Embedding (AAAI 2020) - PyTorch Implementation

Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper

Unofficial PyTorch Implementation of "DOLG: Single-Stage Image Retrieval with Deep Orthogonal Fusion of Local and Global Features"

A generator of point clouds dataset for PyPipes.

tsai is an open-source deep learning package built on top of Pytorch & fastai focused on state-of-the-art techniques for time series classification, regression and forecasting.

6D Grasping Policy for Point Clouds

Unsupervised Feature Ranking via Attribute Networks.

Spearmint Bayesian optimization codebase

Plenoxels: Radiance Fields without Neural Networks, Code release WIP