Code for ICCV 2021 paper "Distilling Holistic Knowledge with Graph Neural Networks"

Last update: Dec 18, 2022

Related tags

Overview

HKD

Code for ICCV 2021 paper "Distilling Holistic Knowledge with Graph Neural Networks"

cifia-100 result

The implementation of compared methods are based on the author-provided code and a open-source benchmark https://github.com/HobbitLong/RepDistiller.

Installation

conda install --yes --file requirements.txt

Running

Fetch the pretrained teacher models by:
```
sh scripts/fetch_pretrained_teachers.sh
```
which will download and save the models to save/models

Run distillation by commands in scripts\run_cifar_distill.sh. An example of running HKD is given by:

python train_student.py --path_t ./save/models/resnet32x4_vanilla/ckpt_epoch_240.pth --distill hkd --model_s resnet8x4 -a 1 -b 3 --mode hkd --trial 1

Citation

The final version of the paper will also be released soon.

Owner

Wang Yucheng

It leads my burning heart to a dark side-road.

GitHub Repository

StyleGAN2 Webtoon / Anime Style Toonify

StyleGAN2 Webtoon / Anime Style Toonify Korea Webtoon or Japanese Anime Character Stylegan2 base high Quality 1024x1024 / 512x512 Generate and Transfe

121 Dec 21, 2022

Large-Scale Unsupervised Object Discovery

Large-Scale Unsupervised Object Discovery Huy V. Vo, Elena Sizikova, Cordelia Schmid, Patrick Pérez, Jean Ponce [PDF] We propose a novel ranking-based

17 Sep 19, 2022

Pytorch codes for Feature Transfer Learning for Face Recognition with Under-Represented Data

FTLNet_Pytorch Pytorch codes for Feature Transfer Learning for Face Recognition with Under-Represented Data 1. Introduction This repo is an unofficial

1 Nov 04, 2020

Kaggle Feedback Prize - Evaluating Student Writing 15th solution

Kaggle Feedback Prize - Evaluating Student Writing 15th solution First of all, I would like to thank the excellent notebooks and discussions from http

6 Mar 24, 2022

Deep Learning Emotion decoding using EEG data from Autism individuals

Deep Learning Emotion decoding using EEG data from Autism individuals This repository includes the python and matlab codes using for processing EEG 2D

12 Dec 08, 2022

Python Environment for Bayesian Learning

Pebl is a python library and command line application for learning the structure of a Bayesian network given prior knowledge and observations. Pebl in

103 Jul 14, 2022

Official code for paper "Demystifying Local Vision Transformer: Sparse Connectivity, Weight Sharing, and Dynamic Weight"

Demysitifing Local Vision Transformer, arxiv This is the official PyTorch implementation of our paper. We simply replace local self attention by (dyna

138 Dec 28, 2022

(JMLR' 19) A Python Toolbox for Scalable Outlier Detection (Anomaly Detection)

Python Outlier Detection (PyOD) Deployment & Documentation & Stats & License PyOD is a comprehensive and scalable Python toolkit for detecting outlyin

6.6k Jan 05, 2023

This repository contains the code used to quantitatively evaluate counterfactual examples in the associated paper.

On Quantitative Evaluations of Counterfactuals Install To install required packages with conda, run the following command: conda env create -f requi

1 Jan 16, 2022

This repo is a C++ version of yolov5_deepsort_tensorrt. Packing all C++ programs into .so files, using Python script to call C++ programs further.

yolov5_deepsort_tensorrt_cpp Introduction This repo is a C++ version of yolov5_deepsort_tensorrt. And packing all C++ programs into .so files, using P

41 Dec 27, 2022

pyhsmm - library for approximate unsupervised inference in Bayesian Hidden Markov Models (HMMs) and explicit-duration Hidden semi-Markov Models (HSMMs), focusing on the Bayesian Nonparametric extensions, the HDP-HMM and HDP-HSMM, mostly with weak-limit approximations.

Bayesian inference in HSMMs and HMMs This is a Python library for approximate unsupervised inference in Bayesian Hidden Markov Models (HMMs) and expli

527 Dec 04, 2022

Code for ICCV 2021 paper "Distilling Holistic Knowledge with Graph Neural Networks"

Related tags

Overview

HKD

cifia-100 result

Installation

Running

Citation

Owner

Wang Yucheng

StyleGAN2 Webtoon / Anime Style Toonify

Large-Scale Unsupervised Object Discovery

Pytorch codes for Feature Transfer Learning for Face Recognition with Under-Represented Data

Kaggle Feedback Prize - Evaluating Student Writing 15th solution

Deep Learning Emotion decoding using EEG data from Autism individuals

Python Environment for Bayesian Learning

Official code for paper "Demystifying Local Vision Transformer: Sparse Connectivity, Weight Sharing, and Dynamic Weight"

(JMLR' 19) A Python Toolbox for Scalable Outlier Detection (Anomaly Detection)

This repository contains the code used to quantitatively evaluate counterfactual examples in the associated paper.

This repo is a C++ version of yolov5_deepsort_tensorrt. Packing all C++ programs into .so files, using Python script to call C++ programs further.

🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

codebase for "A Theory of the Inductive Bias and Generalization of Kernel Regression and Wide Neural Networks"

some academic posters as references. May we have in-person poster session soon!

NHL 94 AI contests

Why Are You Weird? Infusing Interpretability in Isolation Forest for Anomaly Detection

Real-Time and Accurate Full-Body Multi-Person Pose Estimation&Tracking System

A python toolbox for predictive uncertainty quantification, calibration, metrics, and visualization

Trying to understand alias-free-gan.

pyhsmm - library for approximate unsupervised inference in Bayesian Hidden Markov Models (HMMs) and explicit-duration Hidden semi-Markov Models (HSMMs), focusing on the Bayesian Nonparametric extensions, the HDP-HMM and HDP-HSMM, mostly with weak-limit approximations.