chroma
runpodctl
Our great sponsors
chroma | runpodctl | |
---|---|---|
32 | 8 | |
12,189 | 215 | |
8.5% | 11.2% | |
9.7 | 9.4 | |
8 days ago | 16 days ago | |
Python | Go | |
Apache License 2.0 | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
chroma
-
Let’s build AI-tools with the help of AI and Typescript!
Package installer for Python (pip), we use this for installing the Python-based packages, such as Jupyter Lab, and we're going to use this for installing other Python-based tools like the Chroma DB vector database
-
Mixtral 8x22B
Optional: You can use SillyTavern[1] for a more "rich" chat experience
The above lets me chat, at least superficially, with my friend. It's nice for simple interactions and banter; I've found it to be a positive and reflective experience.
0. https://www.trychroma.com/
-
7 Vector Databases Every Developer Should Know!
Chroma DB is a newer entrant in the vector database arena, designed specifically for handling high-dimensional color vectors. It's particularly useful for applications in digital media, e-commerce, and content discovery, where color similarity plays a crucial role in search and recommendation algorithms.
-
AI Grant Traction in OSS Startups
View on GitHub
- Qdrant, the Vector Search Database, raised $28M in a Series A round
-
Vector Databases: A Technical Primer [pdf]
For Python I believe Chroma [1] can be used embedded.
For Go I recently started building chromem-go, inspired by the Chroma interface: https://github.com/philippgille/chromem-go
It's neither advanced nor for scale yet, but the RAG demo works.
[1] https://github.com/chroma-core/chroma
- Chroma – the open-source embedding database
-
Show HN: Embeddings Solution for Personal Journal
The formatting is a bit off.
The web app is here: https://jumblejournal.org
The DB used is here: https://www.trychroma.com/
-
SQLite vs. Chroma: A Comparative Analysis for Managing Vector Embeddings
Whether you’re navigating through well-known options like SQLite, enriched with the sqlite-vss extension, or exploring other avenues like Chroma, an open-source vector database, selecting the right tool is paramount. This article compares these two choices, guiding you through the pros and cons of each, helping you choose the right tool for storing and querying vector embeddings for your project.
-
How to use Chroma to store and query vector embeddings
Create a new project directory for our example project. Next, we need to clone the Chroma repository to get started. At the root of your project directory let's clone Chroma into it:
runpodctl
- Ask HN: What's the best hardware to run small/medium models locally?
-
Old Timer needs help setting up stable diffusion. Extremely confused.
You can rent a GPU on https://www.runpod.io/, which also has stable diffusion templates so any time you start the GPU SD will be preinstalled for you, ready to use:)
-
i need some help guys
Another option is to use a service like www.runpod.io to rent time on more powerful systems. A few times a week I’ll load up whatever the latest 13B or 20/24B (and even low bpw 70Bs with EXL2) model is on a system with an rtx 3090 for $0.44/hr, and sometimes I’ll treat myself to an A6000 system to run 4bit 70Bs for $0.79/hr. They also offer A4000 systems with 16GB VRAM which is plenty to run a 4bpw 13B EXL2 model or an 8bpw 7B model, and those systems are just $0.36/hr.
- GPT-3.5 Turbo fine-tuning and API updates
-
What's the best (and cheap) way to try out all the new LLMs on cloud services.
Many people use sites like runpod for this.
-
Looking for Paperspace (or equivalent) Help
You can rent time on systems on www.runpod.io with a 48GB A6000 for $0.50/hr spot pricing and $0.79/hr regular pricing. 3090s can be had for $0.29/hr spot pricing and $.44/hr regular.
-
only seeing disk cache slider, no gpu anything?
Keep in mind you can also use www.runpod.io to rent access to systems with a 3090 for about $.45/hr. It might be significantly cheaper ir at least more affordable to do this for a few hours a week instead of dropping $1,000 on a new laptop. This is what I personally do (I generally use it in the evening, and can get an Nvidia A6000 with 48GB VRAM for $.49/hr spot pricing). This lets me play with the latest 33B and 65B models, with really fast replies, and I spend maybe $5-7 a week if I use it a lot.
-
What is best bang for buck persistent virtual GPU rental to run SD?
you can also connect the volume to other cloud storage (pcloud, dropbox, etc) (look for the option cloud sync in the "my pods" console) , or use python libraries to pull/push files from S3 buckets / dropbox / ftps / your NAS / etc, or use their docker tools to transfer files between your local PC and the volumehttps://github.com/runpod/runpodctl/blob/main/README.md
What are some alternatives?
SillyTavern - LLM Frontend for Power Users.
koboldcpp - A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
faiss - A library for efficient similarity search and clustering of dense vectors.
KoboldAI-Runpod - This is just a simple set of notebooks to load koboldAI and SillyTavern Extras on a runpod with Pytorch 2.0.1 Template
golang-ical - A ICS / ICal parser and serialiser for Golang.
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
AutoGPT - AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
EveryDream2trainer
qdrant - Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
SillyTavern - LLM Frontend for Power Users. [Moved to: https://github.com/SillyTavern/SillyTavern]
sqlite-vss - A SQLite extension for efficient vector search, based on Faiss!
chroma - A general purpose syntax highlighter in pure Go