This repo includes codes for the paper PermuteFormer: Efficient Relative Position Encoding for Long Sequences. Directory long_range_arena is for experiments on the dataset Long-Range Arena. Directory language_model is for experiments on the dataset WikiText-103.
cpcp1998/PermuteFormer
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
Code for the paper PermuteFormer
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published