chatai
Official Repo for Chat AI (by Capsize-Games)
sparsellama
By lachlansneff
| chatai | sparsellama | |
|---|---|---|
| 3 | 1 | |
| 31 | 39 | |
| - | - | |
| 6.9 | 1.8 | |
| about 1 year ago | about 1 year ago | |
| Python | Python | |
| GNU General Public License v3.0 only | Apache License 2.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
chatai
Posts with mentions or reviews of chatai.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-03-31.
sparsellama
Posts with mentions or reviews of sparsellama.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-03-31.
-
Llama.cpp 30B runs with only 6GB of RAM now
I'd assume that 33B model should fit with this(only repo that I know of that implements SparseGPT and GPTQ for LLaMa) https://github.com/lachlansneff/sparsellama
What are some alternatives?
When comparing chatai and sparsellama you can also consider the following projects:
ChatGPT-Desktop-Webview - Private ChatGPT Desktop Webview app made with QtWebView.
llama.cpp - LLM inference in C/C++
aihandler - A simple engine to help run diffusers and transformers models
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
airunner - Stable Diffusion and LLMs offline on your own hardware
GPTQ-for-LLaMa - 4 bits quantization of LLaMA using GPTQ
PyMera - an application that track your face
ChatGPT-API-Python - Building a Chatbot in Python using OpenAI's Official ChatGPT API
llm - An ecosystem of Rust libraries for working with large language models
chatai vs ChatGPT-Desktop-Webview
sparsellama vs llama.cpp
chatai vs aihandler
sparsellama vs text-generation-webui
chatai vs airunner
sparsellama vs GPTQ-for-LLaMa
chatai vs PyMera
chatai vs text-generation-webui
chatai vs ChatGPT-API-Python
chatai vs llm
chatai vs GPTQ-for-LLaMa
chatai vs llama.cpp