Finetune gpt-2 in google colab

Overview

gpt-2-colab

finetune gpt-2(https://github.com/openai/gpt-2) in google colab

sample result (117M) from retraining on A Tale of Two Cities by Charles Dickens

No, Jerry! Jerry! You're a nice man, Jerry!”

That was all too remarkable. It was not merely impressive, but it took me on a turning short cough, and then swelling and stiffening, and rising to be a nice man, and a man, and not at all strivenly, and wicked.

The wonderful corner for echoes, and the echoes not being the echoes of footsteps that had their shameful imparted on the other side alone, that the time and tide waited for Lucie were sufficiently near the room, that to the utmost remaining of the time, even though assisted off other carriages, and were always ready and drove away that they should not hear themselves, Jerry heard no cry, and were as quick as in the morning if they had to pull up their heads and cidled away together as they could.

The farrier had not been in the barrier when he stopped, for the moment, and was as quick as they could make him.

He was to roll up arms, to get the outer coat to and frolic. He could not have laid down his hand to do so without another rain of the summer drops on high, when he was requested to do so. But, the rain of the summer was very strong and few, and the rain of the autumn month afterwards was strong and warm by those intervals. The storm in the west was very rarely beering, and the storm in the light of the summer was very rarely without it. The storm was really falling, and he stood there for a moment with his hand to open the barrier.

He was so far apart, that he could not have looked at him at all then; for, it was already dark when he looked at this figure, and it looked at IV

(an) seemed to fall, and reappeared, as old as Adam, until the morning, of the hour before.

“I fear the best, well,” said Jerry, stopping in his story, and laying his hand on hers, “what are you?”

“The worst.”

Though he had no hope of saying it, he could have looked at him, and then frowned at another figure, whose surface furnished a kind of dark street before him, for a few jewels.

He looked at it, and glanced at it. The Spy and prison-keeper looked at it, and the Spy showed a broken-hearted look.

“I am very much obliged to them for their looks and faces,” said Jerry. “No, Jerry! They are all in animosity and submission. They are in the habitually consently bad. I know what you have to do with my business. Whether I wait for you under the obligation to do so is the assumption yours. It is little to keep them in their places, to keep them in their times too much, is it not? No, Jerry. It is to keep them in their places, to cost and cost as the like. So much would you cost and change to-do exactly? That is to say, without deigning to say anything that is not at all, and no harm is to be expected of, will you not? No. It will cost nothing to save you, if it wos so, refuse. But it is always in the nature of things, and it is the nature of things. What is it? What would you have to say to me at all as, or to that degree?”

“I would ask you, is it not?”

Hah!” said Jerry, as he paused for the moment to ask him questions.

“It is true,” repeated the last question. “Does it cost to show me no harm, me nothing, yet? No. It is without loss,” repeated the Law; in the resting-looked-down sentiment. “Will you be very soon as restored to you?”

At the Judge, again a Judgeyer.

“If it is not restored to you within a minute, who should shut out the proceedings, and then the prisoner must be put back advance, and then must be removed.”

The Judge, whose eyes had gone in the general direction, leaned back in his seat, and stood ready.

Mr. Attorney-General then, following his leader's guidance, examined his manner with great obsequiousness and closeness, and passing on to the bench and tools, and passing on to Mr. Lorry. After looking at

LSTM based Sentiment Classification using Tensorflow - Amazon Reviews Rating

LSTM based Sentiment Classification using Tensorflow - Amazon Reviews Rating (Dataset) The dataset is from Amazon Review Data (2018)

Immanuvel Prathap S 1 Jan 16, 2022
Topic Inference with Zeroshot models

zeroshot_topics Table of Contents Installation Usage License Installation zeroshot_topics is distributed on PyPI as a universal wheel and is available

Rita Anjana 55 Nov 28, 2022
Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speech Recognition

SEW (Squeezed and Efficient Wav2vec) The repo contains the code of the paper "Performance-Efficiency Trade-offs in Unsupervised Pre-training for Speec

ASAPP Research 67 Dec 01, 2022
TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model training in NLP

TextAttack 🐙 Generating adversarial examples for NLP models [TextAttack Documentation on ReadTheDocs] About • Setup • Usage • Design About TextAttack

QData 2.2k Jan 03, 2023
Unsupervised Abstract Reasoning for Raven’s Problem Matrices

Unsupervised Abstract Reasoning for Raven’s Problem Matrices This code is the implementation of our TIP paper. This is the first unsupervised abstract

Tao Zhuo 9 Dec 17, 2022
Data and code to support "Applied Natural Language Processing" (INFO 256, Fall 2021, UC Berkeley)

anlp21 Course materials for "Applied Natural Language Processing" (INFO 256, Fall 2021, UC Berkeley) Syllabus: http://people.ischool.berkeley.edu/~dba

David Bamman 48 Dec 06, 2022
An easy to use, user-friendly and efficient code for extracting OpenAI CLIP (Global/Grid) features from image and text respectively.

Extracting OpenAI CLIP (Global/Grid) Features from Image and Text This repo aims at providing an easy to use and efficient code for extracting image &

Jianjie(JJ) Luo 13 Jan 06, 2023
Google AI 2018 BERT pytorch implementation

BERT-pytorch Pytorch implementation of Google AI's 2018 BERT, with simple annotation BERT 2018 BERT: Pre-training of Deep Bidirectional Transformers f

Junseong Kim 5.3k Jan 07, 2023
ByT5: Towards a token-free future with pre-trained byte-to-byte models

ByT5: Towards a token-free future with pre-trained byte-to-byte models ByT5 is a tokenizer-free extension of the mT5 model. Instead of using a subword

Google Research 409 Jan 06, 2023
STT for TorchScript is a port of Coqui STT based on DeepSpeech to PyTorch.

st3 STT for TorchScript is a port of Coqui STT based on DeepSpeech to PyTorch. Currently it supports converting pbmm models to pt scripts with integra

Vlad Ki 8 Oct 18, 2021
Finetune gpt-2 in google colab

gpt-2-colab finetune gpt-2 in google colab sample result (117M) from retraining on A Tale of Two Cities by Charles Di

212 Jan 02, 2023
ACL22 paper: Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost

Imputing Out-of-Vocabulary Embeddings with LOVE Makes Language Models Robust with Little Cost LOVE is accpeted by ACL22 main conference as a long pape

Lihu Chen 32 Jan 03, 2023
🚀Clone a voice in 5 seconds to generate arbitrary speech in real-time

English | 中文 Features 🌍 Chinese supported mandarin and tested with multiple datasets: aidatatang_200zh, magicdata, aishell3, data_aishell, and etc. ?

Vega 25.6k Dec 31, 2022
p-tuning for few-shot NLU task

p-tuning_NLU Overview 这个小项目是受乐于分享的苏剑林大佬这篇p-tuning 文章启发,也实现了个使用P-tuning进行NLU分类的任务, 思路是一样的,prompt实现方式有不同,这里是将[unused*]的embeddings参数抽取出用于初始化prompt_embed后

3 Dec 29, 2022
Python generation script for BitBirds

BitBirds generation script Intro This is published under MIT license, which means you can do whatever you want with it - entirely at your own risk. Pl

286 Dec 06, 2022
A BERT-based reverse-dictionary of Korean proverbs

Wisdomify A BERT-based reverse-dictionary of Korean proverbs. 김유빈 : 모델링 / 데이터 수집 / 프로젝트 설계 / back-end 김종윤 : 데이터 수집 / 프로젝트 설계 / front-end Quick Start C

Eu-Bin KIM 94 Dec 08, 2022
This is a really simple text-to-speech app made with python and tkinter.

Tkinter Text-to-Speech App by Souvik Roy This is a really simple tkinter app which converts the text you have entered into a speech. It is created wit

Souvik Roy 1 Dec 21, 2021
An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

The implementation of paper CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval. CLIP4Clip is a video-text retrieval model based

ArrowLuo 456 Jan 06, 2023
AI and Machine Learning workflows on Anthos Bare Metal.

Hybrid and Sovereign AI on Anthos Bare Metal Table of Contents Overview Terraform as IaC Substrate ABM Cluster on GCE using Terraform TensorFlow ResNe

Google Cloud Platform 8 Nov 26, 2022
NumPy String-Indexed is a NumPy extension that allows arrays to be indexed using descriptive string labels

NumPy String-Indexed NumPy String-Indexed is a NumPy extension that allows arrays to be indexed using descriptive string labels, rather than conventio

Aitan Grossman 1 Jan 08, 2022