gptqlora
DB-GPT
| gptqlora | DB-GPT | |
|---|---|---|
| 2 | 10 | |
| 95 | 11,202 | |
| - | 6.2% | |
| 7.6 | 9.9 | |
| 12 months ago | 3 days ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
gptqlora
-
(2/2) May 2023
GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ (https://github.com/qwopqwop200/gptqlora/tree/main)
-
GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
The difference from QLoRA is that GPTQ is used instead of NF4 (Normal Float4) + DQ (Double Quantization) for model quantization. The advantage is that you can expect better performance because it provides better quantization than conventional bitsandbytes. The downside is that it is a one-shot quantization methodology, so it is more inconvenient than bitsandbytes, and unlike bitsandbytes, it is not universal. I'm still experimenting, but it seems to work. At least, I hope it can be more options for people using LoRA. https://github.com/qwopqwop200/gptqlora/tree/main
DB-GPT
-
(2/2) May 2023
Interact your data and environment using the local GPT (https://github.com/csunny/DB-GPT)
- FLaNK Stack Weekly 29 may 2023
- GitHub - csunny/DB-GPT: Interact your data and environment using the local GPT, no data leaks, 100% privately, 100% security
- DB-GPT - OSS to interact with your local LLM
- Show HN: DB-GPT, an LLM tool for database
What are some alternatives?
tree-of-thoughts - Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
private-gpt - Interact with your documents using the power of GPT, 100% privately, no data leaks
GirlfriendGPT - Girlfriend GPT is a Python project to build your own AI girlfriend using ChatGPT4.0
GPTCache - Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
chathub - All-in-one chatbot client
gorilla - Gorilla: An API store for LLMs
chain-of-thought-hub - Benchmarking large language models' complex reasoning ability with chain-of-thought prompting
zamm - Experimental AI chat app
guidance - A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance]
Propan - Propan is a powerful and easy-to-use Python framework for building event-driven applications that interact with any MQ Broker
jj - JSON Stream Editor (command line utility)