Simple Annotated implementation of GPT-NeoX in PyTorch

Last update: Dec 03, 2022

Related tags

Overview

Simple Annotated implementation of GPT-NeoX in PyTorch

This is a simpler implementation of GPT-NeoX in PyTorch. We have taken out several optimizations in GPT-NeoX for simplicity.

Annotated implementation

Sample usages

Owner

labml.ai

Tools to help deep learning researchers

GitHub Repository https://lit.labml.ai/github/labmlai/neox/tree/main/src/neox/__init__.py

Creating an LSTM model to generate music

Music-Generation Creating an LSTM model to generate music music-generator Used to create basic sin wave sounds music-ai Contains the functions to conv

2 Dec 02, 2021

Tokenizer - Module python d'analyse syntaxique et de grammaire, tokenization

Tokenizer Le Tokenizer est un analyseur lexicale, il permet, comme Flex and Yacc par exemple, de tokenizer du code, c'est à dire transformer du code e

1 Aug 15, 2022

nlpcommon is a python Open Source Toolkit for text classification.

nlpcommon nlpcommon, Python Text Tool. Guide Feature Install Usage Dataset Contact Cite Reference Feature nlpcommon is a python Open Source

3 May 29, 2022

【原神】自动演奏风物之诗琴的程序

疯物之诗琴读取midi并自动演奏原神风物之诗琴。可以自定义配置文件自动调整音符来适配风物之诗琴。（原神1.4直播那天就开始做了！到现在才能放出来。。）如何使用在Release页面中下载打包好的程序和midi压缩包并解压。双击运行“疯物之诗琴.exe”。在原神中打开风物之诗琴，软件内输入

435 Jan 04, 2023

Flaxformer: transformer architectures in JAX/Flax

Flaxformer: transformer architectures in JAX/Flax Flaxformer is a transformer library for primarily NLP and multimodal research at Google. It is used

114 Dec 29, 2022

GVT is a generic translation tool for parts of text on the PC screen with Text to Speak functionality.

GVT is a generic translation tool for parts of text on the PC screen with Text to Speech functionality. I wanted to create it because the existing tools that I experimented with did not satisfy me in

1 Aug 21, 2022

LCG T-TEST USING EUCLIDEAN METHOD

This project has been created for statistical usage, purposing for determining ATL takers and nontakers using LCG ttest and Euclidean Method, especially for internal business case in Telkomsel.

2 Jan 21, 2022

ACL22 paper: Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost

Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost LOVE is accpeted by ACL22 main conference as a long pape

32 Jan 03, 2023

Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus Exploration

Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus Exploration This is the official repository for the EMNLP 2021 long pa

70 Dec 11, 2022

A linter to manage all your python exceptions and try/except blocks (limited only for those who like dinosaurs).

Manage your exceptions in Python like a PRO Currently in BETA. Inspired by this blog post. I shared the building process of this tool here. “For those

353 Dec 31, 2022

Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".

Patience-based Early Exit Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit". NEWS: We now have a better and tidier i

54 Jan 04, 2023

Cherche (search in French) allows you to create a neural search pipeline using retrievers and pre-trained language models as rankers.

Cherche (search in French) allows you to create a neural search pipeline using retrievers and pre-trained language models as rankers. Cherche is meant to be used with small to medium sized corpora. C

224 Nov 29, 2022

Simple Annotated implementation of GPT-NeoX in PyTorch

Related tags

Overview

Simple Annotated implementation of GPT-NeoX in PyTorch

Annotated implementation

Sample usages

Owner

labml.ai

Creating an LSTM model to generate music

Tokenizer - Module python d'analyse syntaxique et de grammaire, tokenization

nlpcommon is a python Open Source Toolkit for text classification.

【原神】自动演奏风物之诗琴的程序

Flaxformer: transformer architectures in JAX/Flax

GVT is a generic translation tool for parts of text on the PC screen with Text to Speak functionality.

LCG T-TEST USING EUCLIDEAN METHOD

ACL22 paper: Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost

Phrase-BERT: Improved Phrase Embeddings from BERT with an Application to Corpus Exploration

A linter to manage all your python exceptions and try/except blocks (limited only for those who like dinosaurs).

Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".

Cherche (search in French) allows you to create a neural search pipeline using retrievers and pre-trained language models as rankers.

基于GRU网络的句子判断程序/A program based on GRU network for judging sentences

A Pytorch implementation of "Splitter: Learning Node Representations that Capture Multiple Social Contexts" (WWW 2019).

Graph Coloring - Weighted Vertex Coloring Problem

Use PaddlePaddle to reproduce the paper：mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer

Dope Wars game engine on StarkNet L2 roll-up

MPNet: Masked and Permuted Pre-training for Language Understanding

Client library to download and publish models and other files on the huggingface.co hub

⚡ Automatically decrypt encryptions without knowing the key or cipher, decode encodings, and crack hashes ⚡