rellm
gpt-jargon
| rellm | gpt-jargon | |
|---|---|---|
| 7 | 2 | |
| 491 | 220 | |
| - | - | |
| 5.0 | 7.7 | |
| 9 months ago | 10 months ago | |
| Python | Python | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
rellm
-
Run and create custom ChatGPT-like bots with OpenChat
- https://github.com/r2d4/rellm
-
Forcing GPT-4 or GPT-3.5-turbo to adhere to a specific output format
MS guidance as mentioned and ReLLM
- GitHub - r2d4/rellm: Exact structure out of any language model completion.
- AI Showdown: Wizard Vicuna vs. Stable Vicuna, GPT-4 as the judge (test in comments)
-
ReLLM: Exact Structure for Large Language Model Completions
There's probably a better API that wraps generate, but there's a bit more work than the logit mask.
You have to go one token at a time, otherwise the masking becomes combinatoric rather than linear (two tokens at a time -- need to generate all two token pairs, etc.).
But otherwise, that's what the code does! https://github.com/r2d4/rellm/blob/main/rellm/rellm.py#L21
- r2d4/rellm: Exact structure out of any language model completion.
gpt-jargon
- Run and create custom ChatGPT-like bots with OpenChat
-
Scaffolded LLMs as natural language computers
People have already started writing the languages. Here's an example that I think is really neat: https://github.com/jbrukh/gpt-jargon.
What are some alternatives?
OpenChat - LLMs custom-chatbots console ⚡
convostack - Plug and play embeddable AI chatbot widget and backend deployment framework
simpleAI - An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.
guidance - A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance]
NeMo-Guardrails - NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
llama-api-server - A OpenAI API compatible REST server for llama.
basaran - Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
lmql - A language for constraint-guided and efficient LLM programming.