chroma VS SillyTavern-Extras

Package installer for Python (pip), we use this for installing the Python-based packages, such as Jupyter Lab, and we're going to use this for installing other Python-based tools like the Chroma DB vector database

Optional: You can use SillyTavern[1] for a more "rich" chat experience

The above lets me chat, at least superficially, with my friend. It's nice for simple interactions and banter; I've found it to be a positive and reflective experience.

0. https://www.trychroma.com/

Chroma DB is a newer entrant in the vector database arena, designed specifically for handling high-dimensional color vectors. It's particularly useful for applications in digital media, e-commerce, and content discovery, where color similarity plays a crucial role in search and recommendation algorithms.

View on GitHub

For Python I believe Chroma [1] can be used embedded.

For Go I recently started building chromem-go, inspired by the Chroma interface: https://github.com/philippgille/chromem-go

It's neither advanced nor for scale yet, but the RAG demo works.

[1] https://github.com/chroma-core/chroma

The formatting is a bit off.

The web app is here: https://jumblejournal.org

The DB used is here: https://www.trychroma.com/

Whether you’re navigating through well-known options like SQLite, enriched with the sqlite-vss extension, or exploring other avenues like Chroma, an open-source vector database, selecting the right tool is paramount. This article compares these two choices, guiding you through the pros and cons of each, helping you choose the right tool for storing and querying vector embeddings for your project.

Create a new project directory for our example project. Next, we need to clone the Chroma repository to get started. At the root of your project directory let's clone Chroma into it:

As for SillyTavern, you need the main SillyTavern frontend and SillyTavern-extras (for TTS, STT, etc.) They're pretty easy to install. SillyTavern connects to oobabooga and SillyTavern-extras via API.

Sure, best bet is to follow the instructions on the ST extra's github. It gives a good step by step guide to setting up and running all the addon's. Here is a link in case you need it. https://github.com/SillyTavern/SillyTavern-extras

oobazz + SillyTavern

If you want the best roleplaying experience, I can only recommend SillyTavern with SillyTavern/SillyTavern-extras. The extras include summarization and ChromaDB, both helping to get longer and more coherent chats.

If you haven't already, I sugget you to instal SillyTavern Extra which you can add objective with task, character expression ( personally I generate expression with stable diffusion), and text to speech to diffrent character. You can also set a group scenario if you create group.

Instead, I use the summarize extension for SillyTavern, which is serviceable: https://github.com/SillyTavern/SillyTavern-extras

It doesn't have to be the end. Do what I'm doing and get SillyTavern, use their extension (for expressive sprites), open an OAI account, create some Umineko bots, import your own sprites, and start chatting with them. There's been a lot of advancements in AI visual novel tech. Here's me and the UI's creator in a 5-way group chat with the Quintessential Quintuplets.

The sillytavern-extras: https://github.com/SillyTavern/SillyTavern-extras Classify-extension handles expression, provided you have the pictures. The clever model mentioned in the readme can handle 28 different expressions. It evaluates *while generating* so it can change the pic of 'current speaker', so it'll change as speakers change. I've not spent much time with the group chat, so I never figured out how to do it like it was meant to. BTW, of extras, chromadb is cool, look into it.