llm-plugins
llm-mpt30b
| llm-plugins | llm-mpt30b | |
|---|---|---|
| 1 | 1 | |
| 39 | 30 | |
| - | - | |
| 5.4 | 3.9 | |
| 10 months ago | 11 months ago | |
| Python | ||
| - | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llm-plugins
-
Accessing Llama 2 from the command-line with the LLM-replicate plugin
More about my LLM tool (and Python library) here: https://llm.datasette.io/
Here's the full implementation of that llm-replicate plugin: https://github.com/simonw/llm-replicate/blob/0.2/llm_replica...
If you want to write a plugin for some other LLM I have a detailed tutorial here: https://llm.datasette.io/en/stable/plugins/tutorial-model-pl... - plus a bunch of examples linked from here: https://github.com/simonw/llm-plugins
llm-mpt30b
-
Accessing Llama 2 from the command-line with the LLM-replicate plugin
My LLM tool can be used for both. That's what the plugins are for.
It can talk to OpenAI, PaLM 2 and Llama / other models on Replicate via API, using API keys.
It can run local models on your own machine using these two plugins: https://github.com/simonw/llm-gpt4all and https://github.com/simonw/llm-mpt30b
What are some alternatives?
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
llm-replicate - LLM plugin for models hosted on Replicate
llm-gpt4all - Plugin for LLM adding support for the GPT4All collection of models
llm - Access large language models from the command-line
gpt4all - gpt4all: run open-source LLMs anywhere
ggml - Tensor library for machine learning
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
llama.cpp - LLM inference in C/C++
exllama - A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.