sparsellama
By lachlansneff
chatai
Official Repo for Chat AI (by Capsize-Games)
sparsellama | chatai | |
---|---|---|
1 | 3 | |
39 | 31 | |
- | - | |
1.8 | 6.9 | |
about 1 year ago | about 1 year ago | |
Python | Python | |
Apache License 2.0 | GNU General Public License v3.0 only |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
sparsellama
Posts with mentions or reviews of sparsellama.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-03-31.
-
Llama.cpp 30B runs with only 6GB of RAM now
I'd assume that 33B model should fit with this(only repo that I know of that implements SparseGPT and GPTQ for LLaMa) https://github.com/lachlansneff/sparsellama
chatai
Posts with mentions or reviews of chatai.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-03-31.
What are some alternatives?
When comparing sparsellama and chatai you can also consider the following projects:
llama.cpp - LLM inference in C/C++
ChatGPT-Desktop-Webview - Private ChatGPT Desktop Webview app made with QtWebView.
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
aihandler - A simple engine to help run diffusers and transformers models
GPTQ-for-LLaMa - 4 bits quantization of LLaMA using GPTQ
airunner - Stable Diffusion and LLMs offline on your own hardware
PyMera - an application that track your face
ChatGPT-API-Python - Building a Chatbot in Python using OpenAI's Official ChatGPT API
llm - An ecosystem of Rust libraries for working with large language models
sparsellama vs llama.cpp
chatai vs ChatGPT-Desktop-Webview
sparsellama vs text-generation-webui
chatai vs aihandler
sparsellama vs GPTQ-for-LLaMa
chatai vs airunner
chatai vs PyMera
chatai vs text-generation-webui
chatai vs ChatGPT-API-Python
chatai vs llm
chatai vs GPTQ-for-LLaMa
chatai vs llama.cpp