PyTorch implementation of federated learning framework based on the acceleration of global momentum

Last update: Dec 23, 2021

Related tags

Deep Learning FedAGM

Overview

Federated Learning with Acceleration of Global Momentum

PyTorch implementation of federated learning framework based on the acceleration of global momentum.

Federated Learning with Acceleration of Global Momentum

Geeho Kim, Jinkyu Kim, Bohyung Han

1. Dependencies

This repository is implemented based on PyTorch with Anaconda.

2. Training models

CIFAR-100, 100 clients, Dirichlet (0.3) split, 5% participation

python federated_train.py --cuda_visible_device=1 --method=FedAGM --global_method=FedAGM --config=configs/cifar_actl2.yaml --arch=ResNet18 --weight_decay=1e-3 --gr_clipping_max_norm=10 --alpha=1 --mu=0.001 --gamma=0.9 --momentum=0.0 --tau 1.0 --lr=1e-1 --mode=dirichlet --dirichlet_alpha=0.3  --participation_rate=0.05 --learning_rate_decay 0.995 --set CIFAR100

Owner

GitHub Repository

ExCon: Explanation-driven Supervised Contrastive Learning

ExCon: Explanation-driven Supervised Contrastive Learning Link to the paper: https://arxiv.org/pdf/2111.14271.pdf Contributors of this repo: Zhibo Zha

18 Nov 01, 2022

Gluon CV Toolkit

Gluon CV Toolkit | Installation | Documentation | Tutorials | GluonCV provides implementations of the state-of-the-art (SOTA) deep learning models in

5.4k Jan 06, 2023

SwinIR: Image Restoration Using Swin Transformer

SwinIR: Image Restoration Using Swin Transformer This repository is the official PyTorch implementation of SwinIR: Image Restoration Using Shifted Win

2.4k Jan 05, 2023

SCALoss: Side and Corner Aligned Loss for Bounding Box Regression (AAAI2022).

SCALoss PyTorch implementation of the paper "SCALoss: Side and Corner Aligned Loss for Bounding Box Regression" (AAAI 2022). Introduction IoU-based lo

20 Sep 07, 2022

Latte: Cross-framework Python Package for Evaluation of Latent-based Generative Models

Cross-framework Python Package for Evaluation of Latent-based Generative Models Latte Latte (for LATent Tensor Evaluation) is a cross-framework Python

30 Sep 08, 2022

An Abstract Cyber Security Simulation and Markov Game for OpenAI Gym

gym-idsgame An Abstract Cyber Security Simulation and Markov Game for OpenAI Gym gym-idsgame is a reinforcement learning environment for simulating at

29 Dec 03, 2022

PyTorch code accompanying our paper on Maximum Entropy Generators for Energy-Based Models

Maximum Entropy Generators for Energy-Based Models All experiments have tensorboard visualizations for samples / density / train curves etc. To run th

135 Oct 27, 2022

LexGLUE: A Benchmark Dataset for Legal Language Understanding in English

LexGLUE: A Benchmark Dataset for Legal Language Understanding in English ⚖️ 🏆 🧑‍🎓 👩‍⚖️ Dataset Summary Inspired by the recent widespread use of th

95 Dec 08, 2022

This repository contains the official code of the paper Equivariant Subgraph Aggregation Networks (ICLR 2022)

Equivariant Subgraph Aggregation Networks (ESAN) This repository contains the official code of the paper Equivariant Subgraph Aggregation Networks (IC

59 Dec 13, 2022

Official repository of DeMFI (arXiv.)

DeMFI This is the official repository of DeMFI (Deep Joint Deblurring and Multi-Frame Interpolation). [ArXiv_ver.] Coming Soon. Reference Jihyong Oh a

56 Dec 14, 2022

NeurIPS 2021 Datasets and Benchmarks Track

82 Dec 11, 2022

Code for the Shortformer model, from the paper by Ofir Press, Noah A. Smith and Mike Lewis.

Shortformer This repository contains the code and the final checkpoint of the Shortformer model. This file explains how to run our experiments on the

138 Apr 15, 2022

Optimizes image files by converting them to webp while also updating all references.

About Optimizes images by (re-)saving them as webp. For every file it replaced it automatically updates all references. Works on single files as well

18 Dec 23, 2022

A simple tutoral for error correction task, based on Pytorch

gramcorrector A simple tutoral for error correction task, based on Pytorch Grammatical Error Detection (sentence-level) a binary sequence-based classi

8 Dec 03, 2022

Deep Multimodal Neural Architecture Search

MMNas: Deep Multimodal Neural Architecture Search This repository corresponds to the PyTorch implementation of the MMnas for visual question answering

23 Dec 21, 2022

A custom-designed Spider Robot trained to walk using Deep RL in a PyBullet Simulation

SpiderBot_DeepRL Title: Implementation of Single and Multi-Agent Deep Reinforcement Learning Algorithms for a Walking Spider Robot Authors(s): Arijit

9 Jul 28, 2022

The code for paper "Contrastive Spatio-Temporal Pretext Learning for Self-supervised Video Representation" which is accepted by AAAI 2022

Contrastive Spatio Temporal Pretext Learning for Self-supervised Video Representation (AAAI 2022) The code for paper "Contrastive Spatio-Temporal Pret

8 Jun 30, 2022

PyTorch implementation of federated learning framework based on the acceleration of global momentum

Related tags

Overview

Federated Learning with Acceleration of Global Momentum

1. Dependencies

2. Training models

Owner

ExCon: Explanation-driven Supervised Contrastive Learning

Gluon CV Toolkit

SwinIR: Image Restoration Using Swin Transformer

SCALoss: Side and Corner Aligned Loss for Bounding Box Regression (AAAI2022).

Latte: Cross-framework Python Package for Evaluation of Latent-based Generative Models

An Abstract Cyber Security Simulation and Markov Game for OpenAI Gym

PyTorch code accompanying our paper on Maximum Entropy Generators for Energy-Based Models

LexGLUE: A Benchmark Dataset for Legal Language Understanding in English

This repository contains the official code of the paper Equivariant Subgraph Aggregation Networks (ICLR 2022)

Official repository of DeMFI (arXiv.)

NeurIPS 2021 Datasets and Benchmarks Track

Code for the Shortformer model, from the paper by Ofir Press, Noah A. Smith and Mike Lewis.

Optimizes image files by converting them to webp while also updating all references.

A simple tutoral for error correction task, based on Pytorch

Deep Multimodal Neural Architecture Search

A custom-designed Spider Robot trained to walk using Deep RL in a PyBullet Simulation

The code for paper "Contrastive Spatio-Temporal Pretext Learning for Self-supervised Video Representation" which is accepted by AAAI 2022

Sound Source Localization for AI Grand Challenge 2021

Symbolic Parallel Adaptive Importance Sampling for Probabilistic Program Analysis in JAX

Repo público onde postarei meus estudos de Python, buscando aprender por meio do compartilhamento do aprendizado!