Website which uses Deep Learning to generate horror stories.

View Demo · View Website Repo · Report Bug · Request Feature

 

Creepypasta Website Demo

There are two parts to the project. One is the Deep Learning model which generates the text. The other is the website which uses the model to generate text.

I have used Deep Learning model to generate text. It is a Neural Network which uses Recurrent Neural Network to generate text.

I have hosted a model on Algorithmia and used it's API to generate text.

• React Native
• Algorithmia
• Deployed using Vercel

• How to clear raw data to use it for training.
• How to use Deep Learning model to generate text.
• How to use Algorithmia to generate text.
• How to use Vercel to deploy a website.
• How to use TensorFlow to train a model.
• How to train a model incrementally.
• How to handle large data.
• How to use Machine Learning model to generate text and display it on the website.

To train model follow below steps :

• Reddit API Key

  Go to https://www.reddit.com/prefs/apps/
  

• Algorithmia Account

  Go to https://algorithmia.com/
  

• Optional:

  1. Wandb Account and Wandb API Key to track training

  Go to https://wandb.com/
  

  2. Firebase Account to upload files while scrapping reddit

  To get firebase-adminsdk.json, goto Firebase Console, click on the Gear icon besides Project Overview and select Project Settings -> Service accounts -> Generate new private key.
  
  

  3. Data Sources

     • Go to Data Sources folder and download the files.

  Note: If you don't have a Wandb account, remove Wandb code from the scripts. And if you don't have a Firebase account, remove Firebase code from the scripts.

• Common Steps

  1. Run Reddit Scraping Script.py to scrape data from Reddit.
  2. Run Filter Dates.py to filter dates.
  3. Run Csv to Story Text.py to convert csv to story text.
  4. Run Split Text Files.py to split text files into smaller chunks.
  5. Run Vocabulary details.py to get details of the vocabulary.

• For Word Level

  1. Run Word_Level_Text_Generation_First_Time.ipynb to train the model for the first time.
  2. Run Word_Level_Text_Generation_After_First_Time.ipynb to train the model incrementally.

• For Character Level

  1. Run Charcter_Level_Text_Generation.ipynb to train the model for the first time.
  2. Again run Charcter_Level_Text_Generation.ipynb with changes mentioned to train the model incrementally.

• To host Model on Algorithmia

  1. Go to Algorithmia and create a new project.
  2. Upload all the files in Data Sources to your project.
  3. Past Algorithmia.py to Source Code on Algorithmia.
  4. Add Deppendency to the project.

     algorithmia>=1.0.0,<2.0
     tensorflow-gpu
     keras
     h5py
     

  5. Now Build and Publish the model.

• Now follow the steps to deploy the website, on https://github.com/dhairya0907/Creepypasta-Text-Generator-Website to generate text using website interface.

See the open issues for a list of proposed features (and known issues).

Distributed under the MIT License. See LICENSE for more information.

Dhairya Sharma - @dhairya_0907 - dhairya.sharma532@gmail.com.com

Project Github Link: https://github.com/dhairya0907/Creepypasta-Text-Generator

Project Web Application Link: https://creepypasta-demo.vercel.app