mamba-chat
Mamba-Chat: A chat LLM based on the state-space model architecture 🐍 (by redotvideo)
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models. (by trap20)
mamba-chat | text-generation-webui | |
---|---|---|
4 | 1 | |
843 | 7 | |
8.9% | - | |
7.6 | 9.8 | |
3 months ago | 6 months ago | |
Python | ||
Apache License 2.0 | GNU Affero General Public License v3.0 |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
mamba-chat
Posts with mentions or reviews of mamba-chat.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-10.
-
Integrate LLM Frameworks
Last but certainly not least, we'll demonstrate how to add a custom generation framework. For this example, we'll use the recently released mamba-chat model to build a RAG pipeline. You can read more about the model in this GitHub Repository
-
An interactive demo for Mamba-Chat
Hey everyone! Yesterday, I posted about Mamba-Chat, a chat LLM based on a state space model architecture, and it sparked a lot of interest within the community.
-
Mamba-Chat: A Chat LLM based on State Space Models
Feel free to check out our Github or Huggingface repository! Our Github repo includes a cli chat script, so you can easily run the model if you have access to a GPU.
- Show HN: Mamba-Chat – A Chat LLM Based on State Space Models
text-generation-webui
Posts with mentions or reviews of text-generation-webui.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-07.
-
Mamba-Chat: A Chat LLM based on State Space Models
Seems to run in my hacked together text-generation-webui branch for mamba-ssm: https://github.com/trap20/text-generation-webui/tree/mamba-ssm
What are some alternatives?
When comparing mamba-chat and text-generation-webui you can also consider the following projects:
onnxruntime - ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
mamba
llama.cpp - LLM inference in C/C++
txtai - 💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows
causal-conv1d - Causal depthwise conv1d in CUDA, with a PyTorch interface
bert - TensorFlow code and pre-trained models for BERT