A fluid medium for storing, relating, and surfacing thoughts.

Overview

Conceptarium

A fluid medium for storing, relating, and surfacing thoughts. Read more...

Instructions

The conceptarium takes up about 1GB RAM when running. Clone the repository, and install the requirements using:

python3 -m pip install -r requirements.txt

Note: If you plan to deploy your conceptarium on a Raspberry Pi 4, you'll need a version of pytorch compiled for ARM devices, such as pytorch-rpi.

Start the web server using:

python3 -m uvicorn main:app --reload

This will make your conceptarium available at 127.0.0.1:8000. Go to 127.0.0.1:8000/docs to get an overview of the available endpoints, and read the architecture section of the write-up.

Note: If you want to access your conceptarium remotely, have a look at ngrok.

Simple ways of getting the most out of your conceptarium are by configuring adding it as a search engine via browser extensions, or by creating some AutoKey / AutoHotKey scripts to interact with it via hotkeys.

Comments
  • Installation on Raspberry Pi OS?

    Installation on Raspberry Pi OS?

    I'd first tried to install the conceptarium on the preinstalled 32-bit Pi OS, which failed because I could not get Streamlit to run.

    Then I've tried it with the new 64-bit version of Pi OS. Streamlit works now, but the Pytorch-version linked in the readme could not be installed.

    Have you managed to install the conceptarium on Raspberry Pi OS? If not, which OS have you been using, so that I can try that out?

    opened by phkus 7
  • Unable to access conceptarium via the API

    Unable to access conceptarium via the API

    I've installed it via Docker and entered a token at localhost:8501. But I can't access it through the Curl or Request URL provided in the docs. Check custodian results in "{"custodian":false,"authorized_microverse":[]} and /save in "Only the conceptarium's custodian can save thoughts in it."

    One thing that came to mind: I've used special characters in the token. Could the issue be with the URL encoding?

    opened by phkus 7
  • Help in installation

    Help in installation

    Hi, I'm someone from a non-coding background so I have some difficulties following the instructions in the installation guide. Can you elaborate more on the installation guide (a step-by-step installation procedure would be great) in readme so that individuals from non-technical backgrounds can also make use of this wonderful resource.

    Additionally can you explain how I can self-host this application using a salvaged desktop?

    opened by Nomad-of-Ouroboros 6
  • Unable to search for thoughts

    Unable to search for thoughts

    Unfortunately I have to open another issue, but we're getting there.

    • my token works now
    • I can save thoughts, or at least I get a response with a filename, metadata, and the embeddings

    However, I cannot query for those thoughts. Through the API I just get an internal server error, but through the interface there are more details:

    JSONDecodeError: Expecting value: line 1 column 1 (char 0) Traceback: File "/usr/local/lib/python3.9/site-packages/streamlit/script_runner.py", line 379, in _run_script exec(code, module.dict) File "/app/main.py", line 19, in component.paint() File "/app/components/navigator.py", line 25, in paint st.session_state['authorized_thoughts'] = knowledge.load( File "/app/components/knowledge.py", line 45, in load content = json.loads(response.content) File "/usr/local/lib/python3.9/json/init.py", line 346, in loads return _default_decoder.decode(s) File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None

    opened by phkus 5
  • Where is the docker data stored?

    Where is the docker data stored?

    Hey @paulbricman - really neat work! I'm deploying the conceptarium, ideoscope and lexiscore in docker via docker-compose.

    Quick question: where is the core data stored?

    I'd like to add a volume mount my config so that I can take backups of the data. I looked at the source code and saw the metadata pickle, but this seems to live in /app.

    opened by issmirnov 5
  • Knowledge folder not created when installed from source

    Knowledge folder not created when installed from source

    My imported knowledge folder should have gone into the base conceptarium directory, not the main user folder as was the case with the Docker version.

    Still: Shouldn't it have created such a folder for me when I first try to log in?

    Based on #25

    bug 
    opened by paulbricman 3
  • probem with Docker installation

    probem with Docker installation

    I've installed the new version of the conceptarium on MacOS following the Docker approach. During the installation there were no errors, but now I cannot get the Docker image to run.

    The frontend image exits immediately after starting it, with the following error in the log: Error: Invalid value: File does not exist: main.py Usage: streamlit run [OPTIONS] TARGET [ARGS]... Try 'streamlit run --help' for help.

    The backend image does show as "Running", but looking at the log there is also an error: INFO: Will watch for changes in these directories: ['/app'] INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: Started reloader process [8] using watchgod ERROR: Error loading ASGI app. Could not import module "main".

    opened by phkus 2
  • Docker deployment of conceptarium_frontend

    Docker deployment of conceptarium_frontend

    While deploying with the docker-compose up -d command, I get the following error in the conceptarium_frontend container.

    AttributeError: module 'click' has no attribute 'get_os_args'

    It is resolved by adding 'click' in frontend/requirements.txt

    opened by Trajjan 1
  • Online demo instance showing error - No such file or directory: components

    Online demo instance showing error - No such file or directory: components

    Your online instance hosted on Hugging Face is currently facing an issue, the one you link from your blog:

    FileNotFoundError: [Errno 2] No such file or directory: 'components'
    Traceback:
    
    File "/home/user/.local/lib/python3.8/site-packages/streamlit/script_runner.py", line 354, in _run_script
        exec(code, module.__dict__)
    File "/home/user/app/frontend/main.py", line 12, in <module>
        microverses.paint()
    File "frontend/components/microverses.py", line 24, in paint
        components = [e.split('.')[0] for e in os.listdir('components') if e.endswith(
    

    Unrelated, but thank you for the interesting write-ups!

    opened by NumesSanguis 1
  • API docs now incomplete

    API docs now incomplete

    Since you've changed the way the authorization works, the automatically generated API requests at localhost:8000/docs are not correct, because the token is not included anywhere in the output. After some trial and error, I've found out what works now (add -H 'authorization: Bearer <token>'\ to the curl request), but this might be an issue for someone just trying it out and relying on the requests provided by the docs.

    opened by phkus 1
  • Consider using state of the art semantic similarity algorithms

    Consider using state of the art semantic similarity algorithms

    The state of the art can be found here: https://paperswithcode.com/sota/semantic-textual-similarity-on-sts-benchmark

    Other benchmarcks: https://paperswithcode.com/task/semantic-textual-similarity

    opened by LifeIsStrange 1
  • Batch import via adding notes in knowledge folder

    Batch import via adding notes in knowledge folder

    I'm now curious how to save these notes. I was initially assuming that all text files in the knowledge folder would show up as notes here, but it seems at least the note I placed there is not showing, again I'm sure I'm doing something wrong.

    enhancement 
    opened by paulbricman 0
Releases(v2.0.0)
Owner
An open collective on a mission to augment thought for all.
Subcert is an subdomain enumeration tool, that finds all the subdomains from certificate transparency logs.

Subcert Subcert is a subdomain enumeration tool, that finds all the valid subdomains from certificate transparency logs. Table of contents Setup Demo

A3h1nt 59 Dec 16, 2022
Custom python interface to xstan (a modified (cmd)stan)

Custom python interface to xstan (a modified (cmd)stan) Use at your own risk, currently everything is very brittle and will probably be changed in the

2 Dec 16, 2021
Windows symbol tables for Volatility 3

Windows Symbol Tables for Volatility 3 This repository is the Windows Symbol Table storage for Volatility 3. How to Use $ git clone https://github.com

JPCERT Coordination Center 31 Dec 25, 2022
Convert three types of color in your clipboard and paste it to the color property (gamma correct)

ColorPaster [Blender Addon] Convert three types of color in your clipboard and paste it to the color property (gamma correct) How to Use Hover your mo

13 Oct 31, 2022
1000+ ready code templates to kickstart your next AI experiment

AI Seed Projects Start with ready code for your next AI experiment. Choose from 1000+ code templates, across a wide variety of use cases. All examples

BlobCity, Inc 98 Jan 03, 2023
The first Python 1v1.lol triggerbot working with colors !

1v1.lol TriggerBot Afin d'utiliser mon triggerbot, vous devez activer le plein écran sur 1v1.lol sur votre naviguateur (quelque-soit ce dernier). Vous

Venax 5 Jul 25, 2022
VAST - Visualise Abstract Syntax Trees for Python

VAST VAST - Visualise Abstract Syntax Trees for Python. VAST generates ASTs for a given Python script and builds visualisations of them. Install Insta

Jesse Phillips 2 Feb 18, 2022
A Brainfuck interpreter written in Python.

A Brainfuck interpreter written in Python.

Ethan Evans 1 Dec 05, 2021
Contains the code of my learning of Python OOP.

OOP Python This repository contains the code of my learning of Python OOP. All the code: is following PEP 8 ✅ has proper concept illustrations and com

Samyak Jain 2 Jan 15, 2022
A blazing fast mass certificate generator script for the community ⚡

A simple mass certificate generator script for the community ⚡ Source Code · Docs · Raw Script Docs All you need Certificate Design a simple template

Tushar Nankani 24 Jan 03, 2023
FantasyBballHelper - Espn Fantasy Basketball Helper

ESPN FANTASY BASKETBALL HELPER The simple goal of this project is to allow fanta

1 Jan 18, 2022
Coderslab Workshop Projects

Workshop Coderslab workshop projects that include: Guessing Game Lotto simulator Guessing Game vol.2 Guessing Game vol.3 Dice 2001 Game Technologies P

Szymon Połczyński 1 Nov 06, 2021
This is a modified variation of abhiTronix's vidgear. In this variation, it is possible to write the output file anywhere regardless the permissions.

Info In order to download this package: Windows 10: Press Windows+S, Type PowerShell (cmd in older versions) and hit enter, Type pip install vidgear_n

Ege Akman 3 Jan 30, 2022
A minimalist personal blogging system that natively supports Markdown, LaTeX, and code highlighting.

December Welcome to the December blogging system's code repository! Introduction December is a minimalist personal blogging system that natively suppo

TriNitroTofu 10 Dec 05, 2022
Framework for creating efficient data processing pipelines

Aqueduct Framework for creating efficient data processing pipelines. Contact Feel free to ask questions in telegram t.me/avito-ml Key Features Increas

avito.tech 137 Dec 29, 2022
Click2call for asterisk with python

Click2call para Asterisk com Python Este projeto disponibiliza uma API construíd

Benedito Marques 1 Jan 17, 2022
An OrpheusDL Tidal module

OrpheusDL - Tidal A Tidal module for the OrpheusDL modular archival music program Report Bug · Request Feature Table of content About OrpheusDL - Tida

Daniel 54 Dec 29, 2022
Open Source Repository for CFD Solvers

Background and Validation This wiki is built in Notion. Here are all the tips you need to contribute. General Background Flow over a cylinder The proj

1 Dec 30, 2021
Programa principal de la Silla C.D.P.

Silla CDP Página Web Contáctenos Lista de contenidos: Información del proyecto. Licencias. Contacto. Información del proyecto Silla CDP, o Silla Corre

Silla Control de Postura 1 Dec 02, 2021