llama-api-server
magma-chat
| llama-api-server | magma-chat | |
|---|---|---|
| 1 | 4 | |
| 188 | 206 | |
| - | 4.9% | |
| 6.5 | 8.4 | |
| 3 days ago | 9 months ago | |
| Python | Ruby | |
| MIT License | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llama-api-server
-
Run and create custom ChatGPT-like bots with OpenChat
Disclaimer: I am curating LLM-tools on github [1]
A few thoughts:
* allow for custom endpoint URLs, this way people can use open source LLMs with a fake openAI API backend like basaran[2] or llama-api-server[3]
* look into better embedding methods for info-retrieval like InstructorEmbeddings or Document Summary Index
* Don't use a single embedding per content item, use multiple to increase retrieval quality
1 https://github.com/underlines/awesome-marketing-datascience/...
2 https://github.com/hyperonym/basaran
3 https://github.com/iaalm/llama-api-server
magma-chat
-
Run and create custom ChatGPT-like bots with OpenChat
This feels similar to MagmaChat [1] which I open sourced about a month ago. Except mine is in Ruby on Rails.
[1] https://magmachat.ai
- MagmaChat v0.1.0 Released – Rails 7-based ChatGPT bot platform
-
Google “We Have No Moat, and Neither Does OpenAI”
If you're technical just get yourself OpenAI API access which is super cheap and hook it up to your own self-hosted ChatGPT clone like https://github.com/magma-labs/magma-chat
The wait for GPT-4 is not as long as it used to be, and when you're using the API directly there's no censorship.
- Show HN: Open-Source ChatGPT Bot Platform Written in Ruby on Rails 7
What are some alternatives?
OpenChat - LLMs custom-chatbots console ⚡
convostack - Plug and play embeddable AI chatbot widget and backend deployment framework
IF
NeMo-Guardrails - NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
empirical-philosophy - A collection of empirical experiments using large language models and other neural network architectures to test the usefulness of metaphysical constructs.
gpt-jargon - Jargon is a natural language programming language specified and executed by LLMs like GPT-4.
rellm - Exact structure out of any language model completion.
awesome-ml - Curated list of useful LLM / Analytics / Datascience resources
lmql - A language for constraint-guided and efficient LLM programming.