Download all games from a public Itch.io Game Jam

Overview

Itch Jam Downloader

Downloads all games from a public Itch.io Game Jam.

What you'll need:

  • Python 3.8+
  • pip install -r requirements.txt
  • For site mirroring, wget in your PATH.

On Arch, pacman -S wget python python-requests python-slugify works.

How to use this:

  • Go to your jam's page, ex. https://itch.io/jam/gbcompo21 and right-click -> View Source.
  • Ctrl-F for "id": - it should find that text once, followed by a number. Write it down.
  • (It you found it multiple times, grab the one after ViewJam something something.)
  • Download https://itch.io/jam/NUMBER/entries.json (replacing NUMBER with what you wrote down)
  • Generate a new API key on your user account page: https://itch.io/user/settings/api-keys
  • Run the downloader: python downloader.py --api-key entries.json
  • Wait. This is going to take a while.

The downloader is able to grab more or less everything you can download via the itch app.

It's expected that the downloader output will not be complete - logs are stupidly verbose and it prints a report on successful/failed downloads, so you must manually grab whatever was not handled for you automatically for some reason.

The downloader also grabs the entry page HTML, which usually comes with controls and such. It does not download images, external assets and so on, just the text - if the Itch page dies, so will most elements on those downloaded pages. Controls should survive, though.

(There's a pedantic mirroring toggle in the script, if you know what you're doing though.)

You might also like...
You Can download any video/image in all social medias very easy and High Speed.
You Can download any video/image in all social medias very easy and High Speed.

All-Downloader You Can download any video/image in all social medias very easy and High Speed. also you can easily download videos from web browsers s

Python module to download all media from a CyberDrop gallery.
Python module to download all media from a CyberDrop gallery.

CyberDrop Downloader Intro Let's suppose you found out the Eva G (bby_gee) leak on https://cyberdrop.me/a/aWAt4TWY. You wish you could download the en

Python module to download all media from a GoFile gallery.

GoFile Downloader Setup First of all, clone this repository : ~$ git clone https://github.com/quatrecentquatre-404/gofile-downloader Second, oh wait..

👻🟡  Download all Snapchat video & photo memories from a data export.
👻🟡 Download all Snapchat video & photo memories from a data export.

Snapchat "Memories" Fetcher In compliance with the California Consumer Privacy Act of 2018 (“CCPA”), businesses which collect and store user data must

Heroic-gogdl - GOG Downloading module for Heroic Games Launcher

heroic-gogdl GOG download module for Heroic Games Launcher Purpose This will tak

Simple tool downloads public PoC (refer from nomi-sec)

PoC Collection This is the little script to collect the proof-of-concept which is refered from nomi-sec. The repository now is only develop for linux-

A modern CLI to download animes automatically from Twist
A modern CLI to download animes automatically from Twist

Kurby Kurby is a nice and simple CLI that use Twist website, and their huge collection to download animes for free and automatically Animes from Twist

Download courses from khanacademy.org

khan-dl A python script to download courses from Khan Academy using youtube-dl and beautifulsoup4.

1Fichier Download Manager.
1Fichier Download Manager.

1fichier-dl 1Fichier Download Manager. Features ⭐ Manage your downloads ⭐ Bypass time limits Credits All icons, including the app icon, were provided

Comments
  • NotImplementedError: Unknown infobox block name 'Category'

    NotImplementedError: Unknown infobox block name 'Category'

    Hi!

    INFO:root:Downloading https://andreipasynkov.itch.io/upandown
    Traceback (most recent call last):
      File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main
        return _run_code(code, main_globals, None,
      File "/usr/lib/python3.10/runpy.py", line 86, in _run_code
        exec(code, run_globals)
      File "/tmp/itch-dl/itch_dl/__main__.py", line 3, in <module>
        run()
      File "/tmp/itch-dl/itch_dl/cli.py", line 68, in run
        return drive_downloads(jobs, download_to, args.mirror_web, args.api_key, keys, parallel=args.parallel)
      File "/tmp/itch-dl/itch_dl/downloader.py", line 350, in drive_downloads
        results = [downloader.download(job) for job in tqdm(jobs, **tqdm_args)]
      File "/tmp/itch-dl/itch_dl/downloader.py", line 350, in <listcomp>
        results = [downloader.download(job) for job in tqdm(jobs, **tqdm_args)]
      File "/tmp/itch-dl/itch_dl/downloader.py", line 240, in download
        metadata = self.extract_metadata(game_id, url, site)
      File "/tmp/itch-dl/itch_dl/downloader.py", line 149, in extract_metadata
        infobox = parse_infobox(infobox_div)
      File "/tmp/itch-dl/itch_dl/infobox.py", line 116, in parse_infobox
        parsed_block = parse_tr(name, content_td)
      File "/tmp/itch-dl/itch_dl/infobox.py", line 100, in parse_tr
        raise NotImplementedError(f"Unknown infobox block name '{name}' - please file a new itch-dl issue.")
    NotImplementedError: Unknown infobox block name 'Category' - please file a new itch-dl issue.
    

    ...so I did! Got this from https://itch.io/jam/game-boy-showdown.

    opened by ISSOtm 2
  • Open JSON files in binary mode

    Open JSON files in binary mode

    This avoids any encoding errors caused by JSON files containing non-ASCII characters (e.g. emojis).

    I'm not sure if this encoding issue occurs just on Windows (the corresponding stack trace stems from CP-1252), but I think opening the file in binary mode is the right way to go anyway.

    For reference, here's the traceback logged when trying to load a file which has some emojis in the JSON:

    Traceback (most recent call last):
      File "itch-dl\venv\Scripts\itch-dl", line 5, in <module>
        run()
      File "itch-dl\itch_dl\cli.py", line 60, in run
        jobs = get_jobs_for_url_or_path(args.url_or_path, settings)
      File "itch-dl\itch_dl\handlers.py", line 191, in get_jobs_for_url_or_path
        return get_jobs_for_path(path_or_url)
      File "itch-dl\itch_dl\handlers.py", line 154, in get_jobs_for_path
        json_data = json.load(f)
      File "C:\Python310\lib\json\__init__.py", line 293, in load
        return loads(fp.read(),
      File "C:\Python310\lib\encodings\cp1252.py", line 23, in decode
        return codecs.charmap_decode(input,self.errors,decoding_table)[0]
    UnicodeDecodeError: 'charmap' codec can't decode byte 0x8f in position 22612: character maps to <undefined>
    
    opened by jackwilsdon 1
  • Allow toggling Download Key caching

    Allow toggling Download Key caching

    It's possible to query the API for any available Download Keys directly for a Game ID, instead of downloading them all before the fact. This would be faster for a small amount of titles to download, especially if the user has a ton of purchased/claimed games.

    opened by DragoonAethis 0
Releases(0.3.2)
  • 0.3.2(Nov 1, 2022)

  • 0.3.1(Jun 12, 2022)

  • 0.3.0(Jun 12, 2022)

    • Added Settings - it's now possible to permanently set an API key instead of providing it every single time on the command line. (Using the config file is not mandatory.)
    • itch-dl now depends on Pydantic for config file validation.
    • The User Agent is now being set to python-requests/{version} itch-dl/{version} by default. This is configurable.
    • Misc cleanups, typing fixes and more descriptive error messages with wiki links.
    Source code(tar.gz)
    Source code(zip)
  • 0.2.1(May 30, 2022)

  • 0.2.0(May 15, 2022)

Owner
Dragoon Aethis
Dragoon Aethis
Download courses from khanacademy.org

khan-dl A python script to download courses from Khan Academy using youtube-dl and beautifulsoup4.

rand-net 806 Jan 03, 2023
A cross platform front-end GUI of the popular youtube-dl written in wxPython.

youtube-dlG A cross platform front-end GUI of the popular youtube-dl media downloader written in wxPython. Supported sites Screenshots Requirements Py

8.7k Dec 31, 2022
Music and video downloader, Made with love by Bryan Herrera

Python-Mp3Mp4-Downloader Music and video downloader, Made with love by Bryan Herrera Requirements CHOCOLATELY windows command If your system does not

ርᚱ1ናተᛰ ᚻህᚥተპᚱ 104 Dec 27, 2022
Download candlestick data fast & easy for analysis

crypto-candlesticks 📈 The goal behind this project is to facilitate downloading cryptocurrency candlestick data fast & simple. Currently only the Bit

Pedro Torres 31 Dec 11, 2022
PyDownloader - Downloads files and folders at high speed (based on your interent speed).

PyDownloader - Downloads files and folders at high speed (based on your interent speed).

Armen._.G 4 Feb 24, 2022
QGIS plugin to dwonload DEMs from OpenTopography.org

OpenTopography-DEM-Downloader-qgis-plugin QGIS plugin to dwonload DEMs from OpenTopography.org This plug-in allows you to download DEMs from OpenTopgr

Kyaw Naing Win 7 Sep 20, 2022
Vinetrimmer-DRM-TOOL - Widevine DRM downloader and decrypter for AMZN|NF|STAN And all

🍃 ✂️ Vinetrimmer Widevine DRM downloader and decrypter. Thanks to wvleaks for t

Vlad Tănăsescu 20 Jan 13, 2022
Download your Spotify playlists and songs along with album art and metadata

spotDL Download your Spotify playlists and songs along with album art and metadata The fastest, easiest, and most accurate command-line music download

10.6k Jan 03, 2023
This simple Python script allows you to download songs on Telegram🌸❤️😁

SongsDownloaderTgBot 📺 YouTube Song Downloader Bot For Telegram 🔮 3X Fast Telethon Based Bot ⚜ Open Source Bot 👨🏻‍💻 Demo : 𝗔𝗻𝗻𝗶𝗲 - 𝗘𝗹𝗶𝘇?

Sehath Perera 23 Dec 03, 2022
A simple python script and it's used for mp4 type video downloading from youtube.

This is a simple python script and it's used for mp4 type video downloading from youtube. also, it's used inbuilt python module pytube. Furthermore, I know we have so many apps and online websites to

Yousaf K Hamza 1 Jan 10, 2022
Userscript qutebrowser for downloading audio / video from youtube using aria2

Yt-Downloader Userscript qutebrowser for downloading video / audio from youtube using aria2 by hint links. Requirements Rofi youtube-dl aria2 dunst In

Ara 0 Dec 11, 2021
python code used to download all images contained in a facebook uid , the uid can be profile,group,fanpage

python code used to download all images contained in a facebook uid , the uid can be profile,group,fanpage

VVHai 2 Dec 21, 2021
Um projeto modesto para baixar vídeos do youtube usando tkinter como gui

Youtube Downloader Um projeto modesto para baixar vídeos do youtube usando tkinter como gui Instalação dos requirements: python3 setup.py ou python se

Sunlyx 2 Nov 25, 2021
Command-line program to download videos from YouTube.com and other video sites

youtube-dl - download videos from youtube.com or other video platforms

youtube-dl 116.4k Jan 07, 2023
Youtube-downloader-using-Python - Youtube downloader using Python

Youtube-downloader-using-Python Hii guys !! Fancy to see here Welcome! built by

Lakshmi Deepak 2 Jun 09, 2022
A Python package for downloading / archiving all available episodes from a podcast RSS feed.

allcasts 📻 🗃 A Python package for downloading all available episodes from a podcast RSS feed. Useful for making private archives of your favourite p

Lewis Gentle 5 Nov 20, 2022
一个在新番更新后第一时间在dmhy等BT下载站自动下载的小工具.

Anime Track 一个在新番更新后第一时间自动下载的小工具. 可以根据自定义的关键字在dmhy等BT下载站在搜索结果更新时将磁力链发送至aria2实现自动下载. 基本功能包含: 将BT下载站的某个关键字的搜索结果的所有磁力链添加至ARIA2 自动更新aria2 trackers 将已添加的磁力

Sunky 24 Oct 12, 2022
A simple Python program which uses youtube-dl for downloading YouTube videos as mp3 files.

yt-mp3 converter This is a simple Python program which uses youtube-dl for downloading YouTube videos as mp3 files. This program is for you if you are

nostalgicnerdpenguin 1 Oct 24, 2021
Python/Selenium script to scrape data about university courses

university-courses Python/Selenium script to scrape data about university courses. Script first extracts URLs of each courses homepage, then trawls ea

Sam Brown 1 Feb 02, 2022
Utility for downloading works from AO3 (Archive Of Our Own)

ao3d video preview A small graphical utility for batch downloading works from AO3 (Archive Of Our Own) Features Batch downloading works to supported f

flux 24 Dec 09, 2022