A fluid medium for storing, relating, and surfacing thoughts.

Overview

Conceptarium

A fluid medium for storing, relating, and surfacing thoughts. Read more...

Instructions

The conceptarium takes up about 1GB RAM when running. Clone the repository, and install the requirements using:

python3 -m pip install -r requirements.txt

Note: If you plan to deploy your conceptarium on a Raspberry Pi 4, you'll need a version of pytorch compiled for ARM devices, such as pytorch-rpi.

Start the web server using:

python3 -m uvicorn main:app --reload

This will make your conceptarium available at 127.0.0.1:8000. Go to 127.0.0.1:8000/docs to get an overview of the available endpoints, and read the architecture section of the write-up.

Note: If you want to access your conceptarium remotely, have a look at ngrok.

Simple ways of getting the most out of your conceptarium are by configuring adding it as a search engine via browser extensions, or by creating some AutoKey / AutoHotKey scripts to interact with it via hotkeys.

Comments
  • Installation on Raspberry Pi OS?

    Installation on Raspberry Pi OS?

    I'd first tried to install the conceptarium on the preinstalled 32-bit Pi OS, which failed because I could not get Streamlit to run.

    Then I've tried it with the new 64-bit version of Pi OS. Streamlit works now, but the Pytorch-version linked in the readme could not be installed.

    Have you managed to install the conceptarium on Raspberry Pi OS? If not, which OS have you been using, so that I can try that out?

    opened by phkus 7
  • Unable to access conceptarium via the API

    Unable to access conceptarium via the API

    I've installed it via Docker and entered a token at localhost:8501. But I can't access it through the Curl or Request URL provided in the docs. Check custodian results in "{"custodian":false,"authorized_microverse":[]} and /save in "Only the conceptarium's custodian can save thoughts in it."

    One thing that came to mind: I've used special characters in the token. Could the issue be with the URL encoding?

    opened by phkus 7
  • Help in installation

    Help in installation

    Hi, I'm someone from a non-coding background so I have some difficulties following the instructions in the installation guide. Can you elaborate more on the installation guide (a step-by-step installation procedure would be great) in readme so that individuals from non-technical backgrounds can also make use of this wonderful resource.

    Additionally can you explain how I can self-host this application using a salvaged desktop?

    opened by Nomad-of-Ouroboros 6
  • Unable to search for thoughts

    Unable to search for thoughts

    Unfortunately I have to open another issue, but we're getting there.

    • my token works now
    • I can save thoughts, or at least I get a response with a filename, metadata, and the embeddings

    However, I cannot query for those thoughts. Through the API I just get an internal server error, but through the interface there are more details:

    JSONDecodeError: Expecting value: line 1 column 1 (char 0) Traceback: File "/usr/local/lib/python3.9/site-packages/streamlit/script_runner.py", line 379, in _run_script exec(code, module.dict) File "/app/main.py", line 19, in component.paint() File "/app/components/navigator.py", line 25, in paint st.session_state['authorized_thoughts'] = knowledge.load( File "/app/components/knowledge.py", line 45, in load content = json.loads(response.content) File "/usr/local/lib/python3.9/json/init.py", line 346, in loads return _default_decoder.decode(s) File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None

    opened by phkus 5
  • Where is the docker data stored?

    Where is the docker data stored?

    Hey @paulbricman - really neat work! I'm deploying the conceptarium, ideoscope and lexiscore in docker via docker-compose.

    Quick question: where is the core data stored?

    I'd like to add a volume mount my config so that I can take backups of the data. I looked at the source code and saw the metadata pickle, but this seems to live in /app.

    opened by issmirnov 5
  • Knowledge folder not created when installed from source

    Knowledge folder not created when installed from source

    My imported knowledge folder should have gone into the base conceptarium directory, not the main user folder as was the case with the Docker version.

    Still: Shouldn't it have created such a folder for me when I first try to log in?

    Based on #25

    bug 
    opened by paulbricman 3
  • probem with Docker installation

    probem with Docker installation

    I've installed the new version of the conceptarium on MacOS following the Docker approach. During the installation there were no errors, but now I cannot get the Docker image to run.

    The frontend image exits immediately after starting it, with the following error in the log: Error: Invalid value: File does not exist: main.py Usage: streamlit run [OPTIONS] TARGET [ARGS]... Try 'streamlit run --help' for help.

    The backend image does show as "Running", but looking at the log there is also an error: INFO: Will watch for changes in these directories: ['/app'] INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: Started reloader process [8] using watchgod ERROR: Error loading ASGI app. Could not import module "main".

    opened by phkus 2
  • Docker deployment of conceptarium_frontend

    Docker deployment of conceptarium_frontend

    While deploying with the docker-compose up -d command, I get the following error in the conceptarium_frontend container.

    AttributeError: module 'click' has no attribute 'get_os_args'

    It is resolved by adding 'click' in frontend/requirements.txt

    opened by Trajjan 1
  • Online demo instance showing error - No such file or directory: components

    Online demo instance showing error - No such file or directory: components

    Your online instance hosted on Hugging Face is currently facing an issue, the one you link from your blog:

    FileNotFoundError: [Errno 2] No such file or directory: 'components'
    Traceback:
    
    File "/home/user/.local/lib/python3.8/site-packages/streamlit/script_runner.py", line 354, in _run_script
        exec(code, module.__dict__)
    File "/home/user/app/frontend/main.py", line 12, in <module>
        microverses.paint()
    File "frontend/components/microverses.py", line 24, in paint
        components = [e.split('.')[0] for e in os.listdir('components') if e.endswith(
    

    Unrelated, but thank you for the interesting write-ups!

    opened by NumesSanguis 1
  • API docs now incomplete

    API docs now incomplete

    Since you've changed the way the authorization works, the automatically generated API requests at localhost:8000/docs are not correct, because the token is not included anywhere in the output. After some trial and error, I've found out what works now (add -H 'authorization: Bearer <token>'\ to the curl request), but this might be an issue for someone just trying it out and relying on the requests provided by the docs.

    opened by phkus 1
  • Consider using state of the art semantic similarity algorithms

    Consider using state of the art semantic similarity algorithms

    The state of the art can be found here: https://paperswithcode.com/sota/semantic-textual-similarity-on-sts-benchmark

    Other benchmarcks: https://paperswithcode.com/task/semantic-textual-similarity

    opened by LifeIsStrange 1
  • Batch import via adding notes in knowledge folder

    Batch import via adding notes in knowledge folder

    I'm now curious how to save these notes. I was initially assuming that all text files in the knowledge folder would show up as notes here, but it seems at least the note I placed there is not showing, again I'm sure I'm doing something wrong.

    enhancement 
    opened by paulbricman 0
Releases(v2.0.0)
Owner
An open collective on a mission to augment thought for all.
Load, explore and analyse data from Scotland and rest of the world related to Covid19.

Streamlit Examples This is my first attempt with Streamlit. It is an open-source framework, free, Python-based and easy to use tool to build and deplo

Eyad Elyan 12 Mar 01, 2021
Awesome & interesting talks about programming

Programming Talks I watch a lot of talks that I love to share with my friends, fellows and coworkers. As I consider all GitHubbers my friends (oh yeah

Veit Heller 7k Dec 26, 2022
Sigma coding youtube - This is a collection of all the code that can be found on my YouTube channel Sigma Coding.

Sigma Coding Tutorials & Resources YouTube • Facebook Support Sigma Coding Patreon • GitHub Sponsor • Shop Amazon Table of Contents Overview Topics Re

Alex Reed 927 Jan 08, 2023
For radiometrically calibrating and PSF deconvolving IRIS data

irispreppy For radiometrically calibrating and PSF deconvolving IRIS data. I dislike how I need to own proprietary software (IDL) just to simply prepa

Aaron W. Peat 4 Nov 01, 2022
Grimoire is a Python library for creating interactive fiction as hyperlinked html.

Grimoire Grimoire is a Python library for creating interactive fiction as hyperlinked html. Installation pip install grimoire-if Usage Check out the

Scott Russell 5 Oct 11, 2022
Collection of system-wide scripts that I use on my Gentoo

linux-scripts Collection of scripts that I use on my Gentoo machine. I tend to put all scripts in /scripts directory. It is not likely that you would

Xoores 1 Jan 09, 2022
A C-like hardware description language (HDL) adding high level synthesis(HLS)-like automatic pipelining as a language construct/compiler feature.

██████╗ ██╗██████╗ ███████╗██╗ ██╗███╗ ██╗███████╗ ██████╗ ██╔══██╗██║██╔══██╗██╔════╝██║ ██║████╗ ██║██╔════╝██╔════╝ ██████╔╝██║██████╔╝█

Julian Kemmerer 391 Jan 01, 2023
Python solution of advent-of-code 2021

Advent of code 2021 Python solutions of Advent of Code 2021 written by Eric Bouteillon Requirements The solutions were developed and tested using Pyth

Eric Bouteillon 3 Oct 25, 2022
A basic tool to generate Hydrogen drum machine kits.

Generate Hydrogen Kit A basic tool to generate drumkit.xml files for Hydrogen drum machine. Saves a bit of time when making kits. Supply it with a nam

Luna Langton 2 Nov 28, 2021
This is a simple bank management system based on Python.

Python Bank Management This is a simple bank management system based on Python. It's able to do basic operations of simple bank management. Outcome: W

Md. Rakibul Islam 3 Jan 06, 2022
A Kodi add-on for watching content hosted on PeerTube.

A Kodi add-on for watching content hosted on PeerTube. This add-on is under development so only basic features work, and you're welcome to improve it.

1 Dec 18, 2021
x-tools is a collection of tools developed in Python

x-tools X-tools is a collection of tools developed in Python Commands\

5 Jan 24, 2022
A site that went kinda viral that lets you put Bernie Sanders in places

Bernie In Places An app that accidentally went viral! Read the story in WIRED here Install First, create a python virtual environment, and install all

310 Aug 22, 2022
Security-related flags and options for C compilers

Getting the maximum of your C compiler, for security

135 Nov 11, 2022
A fancy and practical functional tools

Funcy A collection of fancy functional tools focused on practicality. Inspired by clojure, underscore and my own abstractions. Keep reading to get an

Alexander Schepanovski 2.9k Dec 29, 2022
Given tool find related trending keywords of input keyword

blog_generator Given tool find related trending keywords of input keyword (blog_related_to_keyword). Then cretes a mini blog. Currently its customised

Shivanshu Srivastava 2 Nov 30, 2021
Darkflame Universe Account Manager

Darkflame Universe Account Manager This is a quick and simple web application intended for account creation and management for a DLU instance created

31 Nov 29, 2022
Statistics Calculator module for all types of Stats calculations.

Statistics-Calculator This Calculator user the formulas and methods to find the statistical values listed. Statistics Calculator module for all types

2 May 29, 2022
Problem 5: Fermat near-misses

Problem 5: Fermat near-misses fermatnearmiss This is a script that computes fermat nearm misses when the -f option is set and requires users to input

CHRIS BYRON (Int0x80) 1 Jan 08, 2022
Repo with data from local elections in Portugal from 2009 to 2013

autarquicas - local elections in Portugal Repo with data from local elections in Portugal from 2009 to 2013 Objective To provide, to all, raw data fro

Jorge Gomes 6 Apr 06, 2022