Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

Last update: Dec 12, 2022

Related tags

Deep Learning SODEF

Overview

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attackss.

Qiyu Kang, Yang Song, Qinxu Ding, Wee Peng Tay

Environment settings

OS: Ubuntu 18.04
GPU: RTX 2080 Ti, RTX a5000, RTX 3090
Cuda: 11.1 or 10.2
Python: >=3.6
PyTorch: >= 1.6.0
Torchvision: >= 0.7.0

Empirical Evaluations

Compatibility of SODEF

In this section, we show compatibility of SODEF using TRADES:

We append our SODEF after TRADES net to improve the model robustness against adversarial attacks. TRADES works as the feature extractor $h_{\boldsymbol{\phi}}$ as in our paper. Please note TRADES weights are kept fixed during the training. We use the pretrained model provided by TRADES Repo.

Attack / Model	TRADES ℒ_∞	TRADES+SODEF ℒ_∞	TRADES ℒ₂	TRADES+SODEF ℒ₂
Clean	85.48	85.18	85.48	85.18
APGD_CE	56.08	70.90	61.74	74.35
APGD_DLR^T	53.70	64.15	59.22	68.55
FAB^T	54.18	82.92	60.31	83.15
Square	59.12	62.21	72.65	76.02
AutoAttack	53.69	57.76	59.42	67.75

Tab 1. Classification accuracy (%) using TRADES (w/ and w/o SODEF) under AutoAttack on adversarial CIFAR10 examples with ℒ₂ norm (ϵ = 0.5) and ℒ_∞ norm (ϵ = 8/255).

Transfer attack:

Classification accuracy for adv examples generated from original pretrained model using AA ℒ_∞ (ϵ = 8/255) attacks : 61.94%.

cd trades_r
python sodef_eval_ode.py

cd trades_r
sodef_eval_transfer.ipynb

Notification

More test code and models will be uploaded soon after packing.

We currenly only upload the test code for SODEF. Please understand we have strict protocols for code release as this research is partially funded by corporate funding. We will upload the training code as soon as permission is granted.

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

Related tags

Overview

Stable Neural ODE with Lyapunov-Stable Equilibrium Points for Defending Against Adversarial Attacks

Environment settings

Empirical Evaluations

Compatibility of SODEF

In this section, we show compatibility of SODEF using TRADES:

Notification

Owner

Kang Qiyu

FFTNet vocoder implementation

CVPR2022 (Oral) - Rethinking Semantic Segmentation: A Prototype View

Agent-based model simulator for air quality and pandemic risk assessment in architectural spaces

Automatic number plate recognition using tech: Yolo, OCR, Scene text detection, scene text recognation, flask, torch

AI assistant built in python.the features are it can display time,say weather,open-google,youtube,instagram.

Gym Threat Defense

The Pytorch implementation for "Video-Text Pre-training with Learned Regions"

Dataset and Code for ICCV 2021 paper "Real-world Video Super-resolution: A Benchmark Dataset and A Decomposition based Learning Scheme"

Structured Edge Detection Toolbox

Official repository for GCR rerank, a GCN-based reranking method for both image and video re-ID

Isaac Gym Reinforcement Learning Environments

[TIP 2020] Multi-Temporal Scene Classification and Scene Change Detection with Correlation based Fusion

Classify bird species based on their songs using SIamese Networks and 1D dilated convolutions.

ObsPy: A Python Toolbox for seismology/seismological observatories.

DumpSMBShare - A script to dump files and folders remotely from a Windows SMB share

a reimplementation of Optical Flow Estimation using a Spatial Pyramid Network in PyTorch

Vision-Language Transformer and Query Generation for Referring Segmentation (ICCV 2021)

Pytorch library for fast transformer implementations

FedJAX is a library for developing custom Federated Learning (FL) algorithms in JAX.

Official PyTorch implementation of our AAAI22 paper: TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework via Self-Supervised Multi-Task Learning. Code will be available soon.