A fluid medium for storing, relating, and surfacing thoughts.

Overview

Conceptarium

A fluid medium for storing, relating, and surfacing thoughts. Read more...

Instructions

The conceptarium takes up about 1GB RAM when running. Clone the repository, and install the requirements using:

python3 -m pip install -r requirements.txt

Note: If you plan to deploy your conceptarium on a Raspberry Pi 4, you'll need a version of pytorch compiled for ARM devices, such as pytorch-rpi.

Start the web server using:

python3 -m uvicorn main:app --reload

This will make your conceptarium available at 127.0.0.1:8000. Go to 127.0.0.1:8000/docs to get an overview of the available endpoints, and read the architecture section of the write-up.

Note: If you want to access your conceptarium remotely, have a look at ngrok.

Simple ways of getting the most out of your conceptarium are by configuring adding it as a search engine via browser extensions, or by creating some AutoKey / AutoHotKey scripts to interact with it via hotkeys.

Comments
  • Installation on Raspberry Pi OS?

    Installation on Raspberry Pi OS?

    I'd first tried to install the conceptarium on the preinstalled 32-bit Pi OS, which failed because I could not get Streamlit to run.

    Then I've tried it with the new 64-bit version of Pi OS. Streamlit works now, but the Pytorch-version linked in the readme could not be installed.

    Have you managed to install the conceptarium on Raspberry Pi OS? If not, which OS have you been using, so that I can try that out?

    opened by phkus 7
  • Unable to access conceptarium via the API

    Unable to access conceptarium via the API

    I've installed it via Docker and entered a token at localhost:8501. But I can't access it through the Curl or Request URL provided in the docs. Check custodian results in "{"custodian":false,"authorized_microverse":[]} and /save in "Only the conceptarium's custodian can save thoughts in it."

    One thing that came to mind: I've used special characters in the token. Could the issue be with the URL encoding?

    opened by phkus 7
  • Help in installation

    Help in installation

    Hi, I'm someone from a non-coding background so I have some difficulties following the instructions in the installation guide. Can you elaborate more on the installation guide (a step-by-step installation procedure would be great) in readme so that individuals from non-technical backgrounds can also make use of this wonderful resource.

    Additionally can you explain how I can self-host this application using a salvaged desktop?

    opened by Nomad-of-Ouroboros 6
  • Unable to search for thoughts

    Unable to search for thoughts

    Unfortunately I have to open another issue, but we're getting there.

    • my token works now
    • I can save thoughts, or at least I get a response with a filename, metadata, and the embeddings

    However, I cannot query for those thoughts. Through the API I just get an internal server error, but through the interface there are more details:

    JSONDecodeError: Expecting value: line 1 column 1 (char 0) Traceback: File "/usr/local/lib/python3.9/site-packages/streamlit/script_runner.py", line 379, in _run_script exec(code, module.dict) File "/app/main.py", line 19, in component.paint() File "/app/components/navigator.py", line 25, in paint st.session_state['authorized_thoughts'] = knowledge.load( File "/app/components/knowledge.py", line 45, in load content = json.loads(response.content) File "/usr/local/lib/python3.9/json/init.py", line 346, in loads return _default_decoder.decode(s) File "/usr/local/lib/python3.9/json/decoder.py", line 337, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/local/lib/python3.9/json/decoder.py", line 355, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None

    opened by phkus 5
  • Where is the docker data stored?

    Where is the docker data stored?

    Hey @paulbricman - really neat work! I'm deploying the conceptarium, ideoscope and lexiscore in docker via docker-compose.

    Quick question: where is the core data stored?

    I'd like to add a volume mount my config so that I can take backups of the data. I looked at the source code and saw the metadata pickle, but this seems to live in /app.

    opened by issmirnov 5
  • Knowledge folder not created when installed from source

    Knowledge folder not created when installed from source

    My imported knowledge folder should have gone into the base conceptarium directory, not the main user folder as was the case with the Docker version.

    Still: Shouldn't it have created such a folder for me when I first try to log in?

    Based on #25

    bug 
    opened by paulbricman 3
  • probem with Docker installation

    probem with Docker installation

    I've installed the new version of the conceptarium on MacOS following the Docker approach. During the installation there were no errors, but now I cannot get the Docker image to run.

    The frontend image exits immediately after starting it, with the following error in the log: Error: Invalid value: File does not exist: main.py Usage: streamlit run [OPTIONS] TARGET [ARGS]... Try 'streamlit run --help' for help.

    The backend image does show as "Running", but looking at the log there is also an error: INFO: Will watch for changes in these directories: ['/app'] INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: Started reloader process [8] using watchgod ERROR: Error loading ASGI app. Could not import module "main".

    opened by phkus 2
  • Docker deployment of conceptarium_frontend

    Docker deployment of conceptarium_frontend

    While deploying with the docker-compose up -d command, I get the following error in the conceptarium_frontend container.

    AttributeError: module 'click' has no attribute 'get_os_args'

    It is resolved by adding 'click' in frontend/requirements.txt

    opened by Trajjan 1
  • Online demo instance showing error - No such file or directory: components

    Online demo instance showing error - No such file or directory: components

    Your online instance hosted on Hugging Face is currently facing an issue, the one you link from your blog:

    FileNotFoundError: [Errno 2] No such file or directory: 'components'
    Traceback:
    
    File "/home/user/.local/lib/python3.8/site-packages/streamlit/script_runner.py", line 354, in _run_script
        exec(code, module.__dict__)
    File "/home/user/app/frontend/main.py", line 12, in <module>
        microverses.paint()
    File "frontend/components/microverses.py", line 24, in paint
        components = [e.split('.')[0] for e in os.listdir('components') if e.endswith(
    

    Unrelated, but thank you for the interesting write-ups!

    opened by NumesSanguis 1
  • API docs now incomplete

    API docs now incomplete

    Since you've changed the way the authorization works, the automatically generated API requests at localhost:8000/docs are not correct, because the token is not included anywhere in the output. After some trial and error, I've found out what works now (add -H 'authorization: Bearer <token>'\ to the curl request), but this might be an issue for someone just trying it out and relying on the requests provided by the docs.

    opened by phkus 1
  • Consider using state of the art semantic similarity algorithms

    Consider using state of the art semantic similarity algorithms

    The state of the art can be found here: https://paperswithcode.com/sota/semantic-textual-similarity-on-sts-benchmark

    Other benchmarcks: https://paperswithcode.com/task/semantic-textual-similarity

    opened by LifeIsStrange 1
  • Batch import via adding notes in knowledge folder

    Batch import via adding notes in knowledge folder

    I'm now curious how to save these notes. I was initially assuming that all text files in the knowledge folder would show up as notes here, but it seems at least the note I placed there is not showing, again I'm sure I'm doing something wrong.

    enhancement 
    opened by paulbricman 0
Releases(v2.0.0)
Owner
An open collective on a mission to augment thought for all.
Replay Felica Exchange For Python

FelicaReplay Replay Felica Exchange Description Standalone Replay Module Usage Save FelicaRelay (=2.0) output to file, then python replay.py [FILE].

3 Jul 14, 2022
Repo with data from local elections in Portugal from 2009 to 2013

autarquicas - local elections in Portugal Repo with data from local elections in Portugal from 2009 to 2013 Objective To provide, to all, raw data fro

Jorge Gomes 6 Apr 06, 2022
An useful scripts for Misskey

misskey-scripts This place storing useful scripts which made by me. icon-repair Repair broken remote user's icon.

CyberRex 5 Sep 09, 2022
Dump Data from FTDI Serial Port to Binary File on MacOS

Dump Data from FTDI Serial Port to Binary File on MacOS

pandy song 1 Nov 24, 2021
In the works, creating a new Chess Board and way to Play...

sWJz4Chess date started on github.com 11-13-2021 In the works, creating a new Chess Board and way to Play... starting to write this in Pygame, any ind

Shawn 2 Nov 18, 2021
My solutions to Advent of Code 2021 (written in Python)

Advent of Code 2021 This repository contains my solutions for the 2021 edition of Advent of Code. Please do not expect perfectly polished solutions, m

Nils 2 May 29, 2022
emoji-math computes the given python expression and returns either the value or the nearest 5 emojis as measured by cosine similarity.

emoji-math computes the given python expression and returns either the value or the nearest 5 emojis as measured by cosine similarity.

Andrew White 13 Dec 11, 2022
A site that went kinda viral that lets you put Bernie Sanders in places

Bernie In Places An app that accidentally went viral! Read the story in WIRED here Install First, create a python virtual environment, and install all

310 Aug 22, 2022
Location of public benchmarking; primarily final results

CSL_public_benchmark This repo is intended to provide a periodically-updated, public view into genome sequencing benchmarks managed by HudsonAlpha's C

HudsonAlpha Institute for Biotechnology 15 Jun 13, 2022
This script is written with Python for selling steam community items automatically.

SteamCommunityItemAutoSell Description This script is written with Python for selling steam community items automatically. Install git clone https://g

14 Oct 26, 2022
Gunakan Dengan Bijak!!

YMBF Made with ❤️ by ikiwzXD_ menu Results notice me: if you get cp results, save 3/7 days then log in. Install script on Termux $ pkg update && pkg u

Ikiwz 0 Jul 11, 2022
Aoc 2021 kedro playground with python

AOC 2021 Overview This is your new Kedro project, which was generated using Kedro 0.17.5. Take a look at the Kedro documentation to get started. Rules

1 Dec 20, 2021
Synthetik Python Mod - A save editor tool for the game Synthetik written in python

Synthetik_Python_Mod A save editor tool for the game Synthetik written in python

2 Sep 10, 2022
JD-backup is an advanced Python script, that will extract all links from a jDownloader 2 file list and export them to a text file.

JD-backup is an advanced Python script, that will extract all links from a jDownloader 2 file list and export them to a text file.

Kraken.snv 3 Jun 07, 2022
Get a list of all offline/online members in a discord server

Discord server insights Get a list of all offline/online members in a discord server. Uses Selenium to crawl invite links. Config Download Chrome driv

Prakhar Gurunani 3 Oct 21, 2022
This repository contains the exercices for the robotics class at Supaero, 2022.

Supaero robotics, 2022 This repository contains the exercices for the robotics class at Supaero, 2022. The exercices are organized by notebook. Each n

Gepetto team, LAAS-CNRS 5 Aug 01, 2022
A person does not exist image bot

A person does not exist image bot

Fayas Noushad 3 Dec 12, 2021
Trusted sessions for falcon using itsdangerous.

Falcon signed sessions This project allows you to easily add trusted cookies to falcon, it works by storing a signed cookie in the client's browser us

Ward 1 Feb 08, 2022
bamboo-engine 是一个通用的流程引擎,他可以解析,执行,调度由用户创建的流程任务,并提供了如暂停,撤销,跳过,强制失败,重试和重入等等灵活的控制能力和并行、子流程等进阶特性,并可通过水平扩展来进一步提升任务的并发处理能力。

bamboo-engine 是一个通用的流程引擎,他可以解析,执行,调度由用户创建的流程任务,并提供了如暂停,撤销,跳过,强制失败,重试和重入等等灵活的控制能力和并行、子流程等进阶特性,并可通过水平扩展来进一步提升任务的并发处理能力。 整体设计 Quick start 1. 安装依赖 2. 项目初始

腾讯蓝鲸 96 Dec 15, 2022
🍕 A small app with capabilities ordering food and listing them with pub/sub pattern

food-ordering A small app with capabilities ordering food and listing them. Prerequisites Docker Run Tests docker-compose run --rm web ./manage.py tes

Muhammet Mücahit 1 Jan 14, 2022