Pytorch implementation of Learning Rate Dropout.

Last update: Nov 25, 2022

Related tags

Deep Learning Learning-Rate-Dropout

Overview

Learning-Rate-Dropout

Pytorch implementation of Learning Rate Dropout.

Paper Link: https://arxiv.org/pdf/1912.00144.pdf

Train ResNet-34 for Cifar10:

run:

python main.py --model=resnet --optim=adam_lrd --lr=0.001 --LRD_p=0.5

python main.py --model=resnet --optim=adam --lr=0.001

python main.py --model=resnet --optim=sgd_lrd --lr=0.1 --LRD_p=0.5

python main.py --model=resnet --optim=sgd --lr=0.1 

python main.py --model=resnet --optim=rmsprop_lrd --lr=0.001 --LRD_p=0.5

python main.py --model=resnet --optim=rmsprop --lr=0.001

After training, run "plot.py" to show the learning curves.

Owner

GitHub Repository

Pretrained models for Jax/Flax: StyleGAN2, GPT2, VGG, ResNet.

169 Dec 26, 2022

Tgbox-bench - Simple TGBOX upload speed benchmark

TGBOX Benchmark This script will benchmark upload speed to TGBOX storage. Build

1 Jan 09, 2022

Revitalizing CNN Attention via Transformers in Self-Supervised Visual Representation Learning

89 Dec 02, 2022

CLOOB training (JAX) and inference (JAX and PyTorch)

cloob-training Pretrained models There are two pretrained CLOOB models in this repo at the moment, a 16 epoch and a 32 epoch ViT-B/16 checkpoint train

64 Nov 27, 2022

OREO: Object-Aware Regularization for Addressing Causal Confusion in Imitation Learning (NeurIPS 2021)

OREO: Object-Aware Regularization for Addressing Causal Confusion in Imitation Learning (NeurIPS 2021) Video demo We here provide a video demo from co

20 Nov 25, 2022

A PyTorch implementation of "Signed Graph Convolutional Network" (ICDM 2018).

SGCN ⠀ A PyTorch implementation of Signed Graph Convolutional Network (ICDM 2018). Abstract Due to the fact much of today's data can be represented as

251 Nov 30, 2022

Machine learning framework for both deep learning and traditional algorithms

NeoML is an end-to-end machine learning framework that allows you to build, train, and deploy ML models. This framework is used by ABBYY engineers for

704 Dec 27, 2022

A stable algorithm for GAN training

DRAGAN (Deep Regret Analytic Generative Adversarial Networks) Link to our paper - https://arxiv.org/abs/1705.07215 Pytorch implementation (thanks!) -

195 Oct 10, 2022

A bare-bones TensorFlow framework for Bayesian deep learning and Gaussian process approximation

Aboleth A bare-bones TensorFlow framework for Bayesian deep learning and Gaussian process approximation [1] with stochastic gradient variational Bayes

127 Dec 12, 2022

LaBERT - A length-controllable and non-autoregressive image captioning model.

Length-Controllable Image Captioning (ECCV2020) This repo provides the implemetation of the paper Length-Controllable Image Captioning. Install conda

53 Nov 13, 2022

MQBench Quantization Aware Training with PyTorch

MQBench Quantization Aware Training with PyTorch I am using MQBench(Model Quantization Benchmark)(http://mqbench.tech/) to quantize the model for depl

29 Nov 18, 2022

Source code for "Understanding Knowledge Integration in Language Models with Graph Convolutions"

Graph Convolution Simulator (GCS) Source code for "Understanding Knowledge Integration in Language Models with Graph Convolutions" Requirements: PyTor

10 Oct 18, 2022

TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformers.

TransMVSNet This repository contains the official implementation of the paper: "TransMVSNet: Global Context-aware Multi-view Stereo Network with Trans

155 Dec 29, 2022

Keras udrl - Keras implementation of Upside Down Reinforcement Learning

keras_udrl Keras implementation of Upside Down Reinforcement Learning This is me

7 Jan 24, 2022

Object Depth via Motion and Detection Dataset

ODMD Dataset ODMD is the first dataset for learning Object Depth via Motion and Detection. ODMD training data are configurable and extensible, with ea

172 Dec 21, 2022

Optical Character Recognition + Instance Segmentation for russian and english languages

Распознавание рукописного текста в школьных тетрадях Соревнование, проводимое в рамках олимпиады НТО, разработанное Сбером. Платформа ODS. Результаты

21 Dec 19, 2022

This repository provides a basic implementation of our GCPR 2021 paper "Learning Conditional Invariance through Cycle Consistency"

Learning Conditional Invariance through Cycle Consistency This repository provides a basic TensorFlow 1 implementation of the proposed model in our GC

1 Nov 04, 2022

Pytorch implementation of Learning Rate Dropout.

Related tags

Overview

Learning-Rate-Dropout

Owner

Pretrained models for Jax/Flax: StyleGAN2, GPT2, VGG, ResNet.

Tgbox-bench - Simple TGBOX upload speed benchmark

Revitalizing CNN Attention via Transformers in Self-Supervised Visual Representation Learning

CLOOB training (JAX) and inference (JAX and PyTorch)

OREO: Object-Aware Regularization for Addressing Causal Confusion in Imitation Learning (NeurIPS 2021)

A PyTorch implementation of "Signed Graph Convolutional Network" (ICDM 2018).

Machine learning framework for both deep learning and traditional algorithms

A stable algorithm for GAN training

A bare-bones TensorFlow framework for Bayesian deep learning and Gaussian process approximation

LaBERT - A length-controllable and non-autoregressive image captioning model.

MQBench Quantization Aware Training with PyTorch

Source code for "Understanding Knowledge Integration in Language Models with Graph Convolutions"

TransMVSNet: Global Context-aware Multi-view Stereo Network with Transformers.

Keras udrl - Keras implementation of Upside Down Reinforcement Learning

Object Depth via Motion and Detection Dataset

Optical Character Recognition + Instance Segmentation for russian and english languages

This repository provides a basic implementation of our GCPR 2021 paper "Learning Conditional Invariance through Cycle Consistency"

BC3407-Group-5-Project - BC3407 Group Project With Python

Graph Regularized Residual Subspace Clustering Network for hyperspectral image clustering

CAPRI: Context-Aware Interpretable Point-of-Interest Recommendation Framework