llm-plugins
llm-replicate
llm-plugins | llm-replicate | |
---|---|---|
1 | 1 | |
39 | 54 | |
- | - | |
5.4 | 6.1 | |
10 months ago | about 2 months ago | |
Python | ||
- | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llm-plugins
-
Accessing Llama 2 from the command-line with the LLM-replicate plugin
More about my LLM tool (and Python library) here: https://llm.datasette.io/
Here's the full implementation of that llm-replicate plugin: https://github.com/simonw/llm-replicate/blob/0.2/llm_replica...
If you want to write a plugin for some other LLM I have a detailed tutorial here: https://llm.datasette.io/en/stable/plugins/tutorial-model-pl... - plus a bunch of examples linked from here: https://github.com/simonw/llm-plugins
llm-replicate
-
Accessing Llama 2 from the command-line with the LLM-replicate plugin
More about my LLM tool (and Python library) here: https://llm.datasette.io/
Here's the full implementation of that llm-replicate plugin: https://github.com/simonw/llm-replicate/blob/0.2/llm_replica...
If you want to write a plugin for some other LLM I have a detailed tutorial here: https://llm.datasette.io/en/stable/plugins/tutorial-model-pl... - plus a bunch of examples linked from here: https://github.com/simonw/llm-plugins
What are some alternatives?
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
llm - Access large language models from the command-line
llm-gpt4all - Plugin for LLM adding support for the GPT4All collection of models
llm-mpt30b - LLM plugin adding support for the MPT-30B language model
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
gpt4all - gpt4all: run open-source LLMs anywhere
guidance - A guidance language for controlling large language models.
exllama - A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.