Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention

Last update: Dec 15, 2022

Related tags

Deep Learning cosFormer

Overview

cosFormer

Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention

Update log

2022/2/28
- Add core code

License

This repository is released under the Apache 2.0 license as found in the LICENSE file.

Citation

If you use this code for a paper, please cite:

@inproceedings{
  zhen2022cosformer,
  title={cosFormer: Rethinking Softmax In Attention},
  author={Zhen Qin and Weixuan Sun and Hui Deng and Dongxu Li and Yunshen Wei and Baohong Lv and Junjie Yan and Lingpeng Kong and Yiran Zhong},
  booktitle={International Conference on Learning Representations},
  year={2022},
  url={https://openreview.net/forum?id=Bl8CQrx2Up4}
}

Owner

GitHub Repository

Dataset and Code for the paper "DepthTrack: Unveiling the Power of RGBD Tracking" (ICCV2021), and "Depth-only Object Tracking" (BMVC2021)

DeT and DOT Code and datasets for "DepthTrack: Unveiling the Power of RGBD Tracking" (ICCV2021) "Depth-only Object Tracking" (BMVC2021) @InProceedings

55 Dec 15, 2022

Code used to generate the results appearing in "Train longer, generalize better: closing the generalization gap in large batch training of neural networks"

Train longer, generalize better - Big batch training This is a code repository used to generate the results appearing in "Train longer, generalize bet

145 Sep 16, 2022

Deep Learning pipeline for motor-imagery classification.

BCI-ToolBox 1. Introduction BCI-ToolBox is deep learning pipeline for motor-imagery classification. This repo contains five models: ShallowConvNet, De

18 Oct 31, 2022

Non-Official Pytorch implementation of "Face Identity Disentanglement via Latent Space Mapping" https://arxiv.org/abs/2005.07728 Using StyleGAN2 instead of StyleGAN

Face Identity Disentanglement via Latent Space Mapping - Implement in pytorch with StyleGAN 2 Description Pytorch implementation of the paper Face Ide

58 Dec 24, 2022

Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention

Related tags

Overview

cosFormer

Update log

License

Citation

Owner

Dataset and Code for the paper "DepthTrack: Unveiling the Power of RGBD Tracking" (ICCV2021), and "Depth-only Object Tracking" (BMVC2021)

Code used to generate the results appearing in "Train longer, generalize better: closing the generalization gap in large batch training of neural networks"

Deep Learning pipeline for motor-imagery classification.

Non-Official Pytorch implementation of "Face Identity Disentanglement via Latent Space Mapping" https://arxiv.org/abs/2005.07728 Using StyleGAN2 instead of StyleGAN

'Solving the sampling problem of the Sycamore quantum supremacy circuits

Learning from graph data using Keras

CRLT: A Unified Contrastive Learning Toolkit for Unsupervised Text Representation Learning

Hl classification bc - A Network-Based High-Level Data Classification Algorithm Using Betweenness Centrality

Official Pytorch implementation of "CLIPstyler:Image Style Transfer with a Single Text Condition"

Ağ tarayıcı.Gönderdiği paketler ile ağa bağlı olan cihazların IP adreslerini gösterir.

[MedIA2021]MIDeepSeg: Minimally Interactive Segmentation of Unseen Objects from Medical Images Using Deep Learning

DeOldify - A Deep Learning based project for colorizing and restoring old images (and video!)

This is the accompanying toolbox for the paper "A Survey on GANs for Anomaly Detection"

Official code for MPG2: Multi-attribute Pizza Generator: Cross-domain Attribute Control with Conditional StyleGAN

DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing

Implementation of the Swin Transformer in PyTorch.

A torch.Tensor-like DataFrame library supporting multiple execution runtimes and Arrow as a common memory format

Pytorch implementation for Patient Knowledge Distillation for BERT Model Compression

Keras implementation of PersonLab for Multi-Person Pose Estimation and Instance Segmentation.

Repository for the paper "Exploring the Sensory Spaces of English Perceptual Verbs in Natural Language Data"