Top 3 Jupyter Notebook quantization Projects
-
Roy
Roy: A lightweight, model-agnostic framework for crafting advanced multi-agent systems using large language models. (by JosefAlbers)
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
Project mention: My take on Microsoft's `autogen` for multi-agent chat: `Roy` | /r/LocalLLaMA | 2023-10-05So, I spent the weekend putting together Roy. I tried to replicate some of its features but in what I hoped would be a simpler, more straightforward way.
You don't say whether you are running Windows or Linux or whether you need Python code or node. This looks like a useful resource for Linux - https://github.com/abhinand5/gptq_for_langchain/tree/main
Index
What are some of the best open-source quantization projects in Jupyter Notebook? This list will help you:
Project | Stars | |
---|---|---|
1 | optimum-intel | 328 |
2 | Roy | 66 |
3 | gptq_for_langchain | 40 |
Sponsored