basaran
OpenChat
| basaran | OpenChat | |
|---|---|---|
| 22 | 13 | |
| 1,281 | 5,073 | |
| - | 0.6% | |
| 10.0 | 9.5 | |
| 4 months ago | 3 months ago | |
| Python | JavaScript | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
basaran
- OpenLLM
-
Langchain and self hosted LLaMA hosted API
What are the current best "no reinventing the wheel" approaches to have Langchain use an LLM through a locally hosted REST API, the likes of Oobabooga or hyperonym/basaran with streaming support for 4-bit GPTQ?
-
Run and create custom ChatGPT-like bots with OpenChat
Disclaimer: I am curating LLM-tools on github [1]
A few thoughts:
* allow for custom endpoint URLs, this way people can use open source LLMs with a fake openAI API backend like basaran[2] or llama-api-server[3]
* look into better embedding methods for info-retrieval like InstructorEmbeddings or Document Summary Index
* Don't use a single embedding per content item, use multiple to increase retrieval quality
1 https://github.com/underlines/awesome-marketing-datascience/...
2 https://github.com/hyperonym/basaran
3 https://github.com/iaalm/llama-api-server
-
1-Jun-2023
open-source alternative to the OpenAI text completion API (https://github.com/hyperonym/basaran)
- Introducing Basaran: self-hosted open-source alternative to the OpenAI text completion API
- Basaran is an open-source alternative to the OpenAI text completion API
-
Ask HN: What's the best self hosted/local alternative to GPT-4?
Guanaco-65B[0] using Basaran[1] for your OpenAI compatible API. You can use any ChatGPT front-end which lets you change the OpenAI endpoint URL.
[0] An fp4 finetune of LLaMA-30B by Tim Dettmers
[1] https://github.com/hyperonym/basaran
-
Are all the finetunes stupid?
For lm-eval, I think you'd either need to take GPTQ's inference script and shim it into a model: https://github.com/EleutherAI/lm-evaluation-harness/tree/master/lm_eval/models or you might be able to use a project like https://github.com/hyperonym/basaran and then you could use the gpt3 model...
-
Using the API in Node
There are also: - Basaran repo: "Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models". "...Compatibility with OpenAI API and client libraries..."; - llama-cpp-python repo: "Simple Python bindings for @ggerganov's llama.cpp library...". "...OpenAI-like API...".
-
Researcher looking for help with how to prepare a finetuning dataset for models like Bloomz and Cerebras-GPT
I want to start with a totally freely available model, so again, that excludes things like LLaMA where the weights are only available through a wait list. The two models that most get my attention and (I think, and hope) fit my criteria of open availability are Cerebras-GPT (13b) and Bloomz (7b). The tools to process and fine-tune that seem most feasible to me, from my limit knowledge, are xturing and basaran.
OpenChat
-
Open source Q&A chatbot UI Recommendation?
Any recommendations for an open source repos that support web based chat ui where you can upload docs,pds,links,etc? So far i found https://github.com/openchatai/OpenChat but it doesnt support llama, claude, etc. Theres also https://github.com/h2oai/h2ogpt but their gradio UI is overly complicated (meant for technical people) and not user friendly.
-
OpenCopilot – AI Copilot (sidekick) for your own SaaS product
I think that is fair.
I deleted the old custom license and replaced it with MIT license.
https://github.com/openchatai/OpenChat/blob/main/LICENSE
We will also make sure that MIT is our to-go license in the coming projects.
- OpenChat - LLMs custom-chatbots console
-
Run and create custom ChatGPT-like bots with OpenChat
I just wrote a GitHub issue outlining some questions I have about this project. I presume will get deleted soon so I'm posting here:
https://github.com/openchatai/OpenChat/issues/43
- You can upload your entire codebase/git repo to OpenChat and ask GPT-3 to implement whatever you want. it will have the full context of your code base and it will answer your questions in the same style it's written in your codebase.
- OpenChat - Custom ChatGPT for anything (with ability to embed the chatbot on your website as a widget)
- Show HN: OpenChat – Open-Source LLM chatbots console
What are some alternatives?
text-generation-inference - Large Language Model Text Generation Inference
llama-api-server - A OpenAI API compatible REST server for llama.
openai-chatgpt-opentranslator - Python command that uses openai to perform text translations
guidance - A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance]
AutoGPTQ - An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
NeMo-Guardrails - NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
simpleAI - An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.
llm-foundry - LLM training code for Databricks foundation models
gpt-jargon - Jargon is a natural language programming language specified and executed by LLMs like GPT-4.
alpaca.cpp - Locally run an Instruction-Tuned Chat-Style LLM
convostack - Plug and play embeddable AI chatbot widget and backend deployment framework