rellm
magma-chat
| rellm | magma-chat | |
|---|---|---|
| 7 | 4 | |
| 491 | 206 | |
| - | 4.9% | |
| 5.0 | 8.4 | |
| 9 months ago | 9 months ago | |
| Python | Ruby | |
| MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
rellm
-
Run and create custom ChatGPT-like bots with OpenChat
- https://github.com/r2d4/rellm
-
Forcing GPT-4 or GPT-3.5-turbo to adhere to a specific output format
MS guidance as mentioned and ReLLM
- GitHub - r2d4/rellm: Exact structure out of any language model completion.
- AI Showdown: Wizard Vicuna vs. Stable Vicuna, GPT-4 as the judge (test in comments)
-
ReLLM: Exact Structure for Large Language Model Completions
There's probably a better API that wraps generate, but there's a bit more work than the logit mask.
You have to go one token at a time, otherwise the masking becomes combinatoric rather than linear (two tokens at a time -- need to generate all two token pairs, etc.).
But otherwise, that's what the code does! https://github.com/r2d4/rellm/blob/main/rellm/rellm.py#L21
- r2d4/rellm: Exact structure out of any language model completion.
magma-chat
-
Run and create custom ChatGPT-like bots with OpenChat
This feels similar to MagmaChat [1] which I open sourced about a month ago. Except mine is in Ruby on Rails.
[1] https://magmachat.ai
- MagmaChat v0.1.0 Released – Rails 7-based ChatGPT bot platform
-
Google “We Have No Moat, and Neither Does OpenAI”
If you're technical just get yourself OpenAI API access which is super cheap and hook it up to your own self-hosted ChatGPT clone like https://github.com/magma-labs/magma-chat
The wait for GPT-4 is not as long as it used to be, and when you're using the API directly there's no censorship.
- Show HN: Open-Source ChatGPT Bot Platform Written in Ruby on Rails 7
What are some alternatives?
OpenChat - LLMs custom-chatbots console ⚡
gpt-jargon - Jargon is a natural language programming language specified and executed by LLMs like GPT-4.
IF
convostack - Plug and play embeddable AI chatbot widget and backend deployment framework
empirical-philosophy - A collection of empirical experiments using large language models and other neural network architectures to test the usefulness of metaphysical constructs.
guidance - A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance]
llama-api-server - A OpenAI API compatible REST server for llama.
basaran - Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
lmql - A language for constraint-guided and efficient LLM programming.