OpenChatKit
petals
OpenChatKit | petals | |
---|---|---|
23 | 99 | |
8,996 | 8,744 | |
0.0% | 2.0% | |
6.5 | 8.3 | |
about 1 month ago | 23 days ago | |
Python | Python | |
Apache License 2.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
OpenChatKit
- OpenChatKit - OSS Framework for building chatbots
-
How should I get an in-depth mathematical understanding of generative AI?
ChatGPT isn't open sourced so we don't know what the actual implementation is. I think you can read Open Assistant's source code for application design. If that is too much, try Open Chat Toolkit's source code for developer tools . If you need very bare implementation, you should go for lucidrains/PaLM-rlhf-pytorch.
- OpenChatKit
- OpenChatKit: Open-source kit for setting up a local, libre, LLM chatbot
-
I created a locally-run ai assistant for UE5’s documentation
For a locally run open source option, I'd recommend taking a look at OpenChatKit. It's built on top of a couple different open source LLMs that have been fine-tuned for use as chatbots. I've only messed around with the online demo a little bit, but from what I've read it is supposed to run on a laptop and be almost as good as ChatGPT 3.5.
-
[D] Are there any MIT licenced (or similar) open-sourced instruction-tuned LLMs available?
OpenChatKit https://github.com/togethercomputer/OpenChatKit
-
[D] Is there currently anything comparable to the OpenAI API?
Togethercomputer released openchatkit a few weeks ago. Not tested it but looks promising https://github.com/togethercomputer/OpenChatKit
petals
-
Mistral Large
So how long until we can do an open source Mistral Large?
We could make a start on Petals or some other open source distributed training network cluster possibly?
[0] https://petals.dev/
-
Distributed Inference and Fine-Tuning of Large Language Models over the Internet
Can check out their project at https://github.com/bigscience-workshop/petals
- Make no mistake—AI is owned by Big Tech
- Would you donate computation and storage to help build an open source LLM?
-
Run 70B LLM Inference on a Single 4GB GPU with This New Technique
There is already an implementation along the same line using the torrent architecture.
https://petals.dev/
-
Run LLMs in bittorrent style
Check it out at Petals.dev. Chatbot
- Is distributed computing dying, or just fading into the background?
-
Ask HN: Are there any projects currently exploring distributed AI training?
https://github.com/bigscience-workshop/petals
-
Mistral 7B,The complete Guide of the Best 7B model
https://github.com/bigscience-workshop/petals
Inference only: https://lite.koboldai.net/
- Run LLMs at home, BitTorrent‑style
What are some alternatives?
alpaca.cpp - Locally run an Instruction-Tuned Chat-Style LLM
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
roomGPT - Upload a photo of your room to generate your dream room with AI.
llama - Inference code for Llama models
Open-Assistant - OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.
alpaca-lora - Instruct-tune LLaMA on consumer hardware
wik - wik is use to get information about anything on the shell using Wikipedia.
GLM-130B - GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)
simple-llm-finetuner - Simple UI for LLM Model Finetuning
Auto-GPT - An experimental open-source attempt to make GPT-4 fully autonomous. [Moved to: https://github.com/Significant-Gravitas/Auto-GPT]
minChatGPT - A minimum example of aligning language models with RLHF similar to ChatGPT