ReLoss - Official implementation for paper "Relational Surrogate Loss Learning" ICLR 2022

Last update: Nov 22, 2022

Overview

Relational Surrogate Loss Learning (ReLoss)

Official implementation for paper "Relational Surrogate Loss Learning" in International Conference on Learning Representations (ICLR) 2022.

By Tao Huang, Zekang Li, Hua Lu, Yong Shan, Shusheng Yang, Yang Feng, Fei Wang, Shan You, Chang Xu.

Usage

Install ReLoss

pip install git+https://github.com/hunto/ReLoss.git

Or install for development:

git clone https://github.com/hunto/ReLoss
cd ReLoss
pip install -e .

Training with ReLoss

All the inputs and outputs of ReLoss are the same as the original loss.

classification

from reloss.cls import ReLoss
loss_fn = ReLoss()

human pose estimation

from reloss.pose import ReLoss
loss_fn = ReLoss(heatmap_size=(64, 48))

Citation

@inproceedings{
huang2022relational,
title={Relational Surrogate Loss Learning},
author={Tao Huang and Zekang Li and Hua Lu and Yong Shan and Shusheng Yang and Yang Feng and Fei Wang and Shan You and Chang Xu},
booktitle={International Conference on Learning Representations},
year={2022},
url={https://openreview.net/forum?id=dZPgfwaTaXv}
}

You might also like...

[ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization

F8Net Fixed-Point 8-bit Only Multiplication for Network Quantization (ICLR 2022 Oral) OpenReview | arXiv | PDF | Model Zoo | BibTex PyTorch implementa

76 Dec 13, 2022

[ICLR 2022] DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETR

DAB-DETR This is the official pytorch implementation of our ICLR 2022 paper DAB-DETR. Authors: Shilong Liu, Feng Li, Hao Zhang, Xiao Yang, Xianbiao Qi

336 Dec 25, 2022

Official code for the ICLR 2021 paper Neural ODE Processes

Neural ODE Processes Official code for the paper Neural ODE Processes (ICLR 2021). Abstract Neural Ordinary Differential Equations (NODEs) use a neura

50 Oct 28, 2022

Official repository for the ICLR 2021 paper Evaluating the Disentanglement of Deep Generative Models with Manifold Topology

Official repository for the ICLR 2021 paper Evaluating the Disentanglement of Deep Generative Models with Manifold Topology Sharon Zhou, Eric Zelikman

34 Nov 16, 2022

Official codebase for ICLR oral paper Unsupervised Vision-Language Grammar Induction with Shared Structure Modeling

CLIORA This is the official codebase for ICLR oral paper: Unsupervised Vision-Language Grammar Induction with Shared Structure Modeling. We introduce

32 Dec 23, 2022

The official implementation of NeMo: Neural Mesh Models of Contrastive Features for Robust 3D Pose Estimation [ICLR-2021]. https://arxiv.org/pdf/2101.12378.pdf

NeMo: Neural Mesh Models of Contrastive Features for Robust 3D Pose Estimation [ICLR-2021] Release Notes The offical PyTorch implementation of NeMo, p

76 Nov 23, 2022

Official implementation of Self-supervised Graph Attention Networks (SuperGAT), ICLR 2021.

SuperGAT Official implementation of Self-supervised Graph Attention Networks (SuperGAT). This model is presented at How to Find Your Friendly Neighbor

127 Dec 28, 2022

Official PyTorch implementation of "Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets" (ICLR 2021)

Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets This is the official PyTorch implementation for the paper Rapid Neural A

48 Dec 26, 2022

Official Implementation of 'UPDeT: Universal Multi-agent Reinforcement Learning via Policy Decoupling with Transformers' ICLR 2021(spotlight)

UPDeT Official Implementation of UPDeT: Universal Multi-agent Reinforcement Learning via Policy Decoupling with Transformers (ICLR 2021 spotlight) The

96 Dec 22, 2022

Comments

train_reloss.py is not runnable

Hi, Thanks for sharing your awesome work. I notice there are many typos and un-existed parameters in train_reloss.py, such as the code from line 33-40. 'i' is not defined, and 'logits, targets' from the corresponding batch are not used in the following code.

opened by lwmlyy 12
Update spearman.py

In https://arxiv.org/abs/2203.09630, we propose monotonic differentiable sorting networks which perform better than logistic with ART. Thus, we changed the default interpolation_type to cauchy in our recent update to diffsort. While cauchy might work better, I suggest specifying the interpolation type explicitly for reproducibility.

Best regards,

Felix

opened by Felix-Petersen 2

ReLoss - Official implementation for paper "Relational Surrogate Loss Learning" ICLR 2022

Related tags

Overview

Relational Surrogate Loss Learning (ReLoss)

Usage

Install ReLoss

Training with ReLoss

Citation

You might also like...

[ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization

[ICLR 2022] DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETR

Official code for the ICLR 2021 paper Neural ODE Processes

Official repository for the ICLR 2021 paper Evaluating the Disentanglement of Deep Generative Models with Manifold Topology

Official codebase for ICLR oral paper Unsupervised Vision-Language Grammar Induction with Shared Structure Modeling

The official implementation of NeMo: Neural Mesh Models of Contrastive Features for Robust 3D Pose Estimation [ICLR-2021]. https://arxiv.org/pdf/2101.12378.pdf

Official implementation of Self-supervised Graph Attention Networks (SuperGAT), ICLR 2021.

Official PyTorch implementation of "Rapid Neural Architecture Search by Learning to Generate Graphs from Datasets" (ICLR 2021)

Official Implementation of 'UPDeT: Universal Multi-agent Reinforcement Learning via Policy Decoupling with Transformers' ICLR 2021(spotlight)

Comments

train_reloss.py is not runnable

Update spearman.py

Releases(v1.0.0)

v1.0.0(Feb 18, 2022)

Owner

Tao Huang

code and models for "Laplacian Pyramid Reconstruction and Refinement for Semantic Segmentation"

Attack on Confidence Estimation algorithm from the paper "Disrupting Deep Uncertainty Estimation Without Harming Accuracy"

Nested Graph Neural Network (NGNN) is a general framework to improve a base GNN's expressive power and performance

This is the official implementation of "One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrieval".

Official repository of DeMFI (arXiv.)

Extending JAX with custom C++ and CUDA code

Solver for Large-Scale Rank-One Semidefinite Relaxations

Collective Multi-type Entity Alignment Between Knowledge Graphs (WWW'20)

VSR-Transformer - This paper proposes a new Transformer for video super-resolution (called VSR-Transformer).

Keqing Chatbot With Python

Code for generating the figures in the paper "Capacity of Group-invariant Linear Readouts from Equivariant Representations: How Many Objects can be Linearly Classified Under All Possible Views?"

PyTorch implementations of neural network models for keyword spotting

Adjust Decision Boundary for Class Imbalanced Learning

Add gui for YoloV5 using PyQt5

Quasi-Dense Similarity Learning for Multiple Object Tracking, CVPR 2021 (Oral)

Official PyTorch Implementation of Rank & Sort Loss [ICCV2021]

Framework for Spectral Clustering on the Sparse Coefficients of Learned Dictionaries

A minimalist environment for decision-making in autonomous driving

Sibur challange 2021 competition - 6 place

A pytorch implementation of Pytorch-Sketch-RNN