cog
chroma
Our great sponsors
cog | chroma | |
---|---|---|
20 | 32 | |
7,133 | 12,324 | |
8.2% | 8.5% | |
9.4 | 9.8 | |
7 days ago | about 7 hours ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cog
-
AI Grant Traction in OSS Startups
View on GitHub
- Insanely Fast Whisper: Transcribe 300 minutes of audio in less than 98 seconds
-
Talk-Llama
I'm in the same situation. I found this cog project to dockerise ML https://github.com/replicate/cog : you write just one python class and a yaml file, and it takes care of the "CUDA hell" and deps. It even creates a flask app in front of your model.
That helps keep your system clean, but someone with big $s please rewrite pytorch to golang or rust or even nodejs / typescript.
-
Llama 2 – Meta AI
https://github.com/replicate/cog
Our thinking was just that a bunch of folks will want to fine-tune right away, then deploy the fine-tunes, so trying to make that easy... Or even just deploy the models-as-is on their own infra without dealing with CUDA insanity!
-
Handling concurrent requests to ML model API
I have used this tool before: https://github.com/replicate/cog/tree/main
-
Opinions on Cog: Containers for machine learning
Then I discovered Cog: Containers for Machine Learning. Looks like a way more flexible solution to plug in the existing infrastructure: you write your custom code and Cog plugs it in a Docker image with FastAPI, no extra ecosystem complexity added.
-
can someone teach me how to install the new stable diffusion repo?
Highly recommend using cog https://github.com/replicate/cog
- Run Stable Diffusion on Your M1 Mac’s GPU
- replicate/cog: Containers for machine learning
-
Why companies move off Heroku (besides the cost)
Dokku Maintainer here.
Dokku also supports Dockerfiles, Docker Images, Tarballs (similar to heroku slugs), and Cloud Native Buildpacks. I'm also actively working on AWS Lambda support (both for simple usage without much config as well as SAM-based usage) and investigating Replicate's Cog[1] and Railways Nixpacks[2] functionalities for building apps.
There are quite a few options in the OSS space (as well as Commercial offerings from new startups and popular incumbents). It's an interesting space to be in, and its always fun to see how new offerings innovate on existing solutions.
[1] https://github.com/replicate/cog
chroma
-
Let’s build AI-tools with the help of AI and Typescript!
Package installer for Python (pip), we use this for installing the Python-based packages, such as Jupyter Lab, and we're going to use this for installing other Python-based tools like the Chroma DB vector database
-
Mixtral 8x22B
Optional: You can use SillyTavern[1] for a more "rich" chat experience
The above lets me chat, at least superficially, with my friend. It's nice for simple interactions and banter; I've found it to be a positive and reflective experience.
0. https://www.trychroma.com/
-
7 Vector Databases Every Developer Should Know!
Chroma DB is a newer entrant in the vector database arena, designed specifically for handling high-dimensional color vectors. It's particularly useful for applications in digital media, e-commerce, and content discovery, where color similarity plays a crucial role in search and recommendation algorithms.
-
AI Grant Traction in OSS Startups
View on GitHub
- Qdrant, the Vector Search Database, raised $28M in a Series A round
-
Vector Databases: A Technical Primer [pdf]
For Python I believe Chroma [1] can be used embedded.
For Go I recently started building chromem-go, inspired by the Chroma interface: https://github.com/philippgille/chromem-go
It's neither advanced nor for scale yet, but the RAG demo works.
[1] https://github.com/chroma-core/chroma
- Chroma – the open-source embedding database
-
Show HN: Embeddings Solution for Personal Journal
The formatting is a bit off.
The web app is here: https://jumblejournal.org
The DB used is here: https://www.trychroma.com/
-
SQLite vs. Chroma: A Comparative Analysis for Managing Vector Embeddings
Whether you’re navigating through well-known options like SQLite, enriched with the sqlite-vss extension, or exploring other avenues like Chroma, an open-source vector database, selecting the right tool is paramount. This article compares these two choices, guiding you through the pros and cons of each, helping you choose the right tool for storing and querying vector embeddings for your project.
-
How to use Chroma to store and query vector embeddings
Create a new project directory for our example project. Next, we need to clone the Chroma repository to get started. At the root of your project directory let's clone Chroma into it:
What are some alternatives?
nixpacks - App source + Nix packages + Docker = Image
SillyTavern - LLM Frontend for Power Users.
pytorch_wavelets - Pytorch implementation of 2D Discrete Wavelet (DWT) and Dual Tree Complex Wavelet Transforms (DTCWT) and a DTCWT based ScatterNet
faiss - A library for efficient similarity search and clustering of dense vectors.
piku - The tiniest PaaS you've ever seen. Piku allows you to do git push deployments to your own servers.
golang-ical - A ICS / ICal parser and serialiser for Golang.
heroku-review-app-actions - GitHub action to automate managing review apps on your Heroku account
AutoGPT - AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
tvm - Open deep learning compiler stack for cpu, gpu and specialized accelerators
qdrant - Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
memray - Memray is a memory profiler for Python
SillyTavern - LLM Frontend for Power Users. [Moved to: https://github.com/SillyTavern/SillyTavern]