llm-replicate
llm-mpt30b
llm-replicate | llm-mpt30b | |
---|---|---|
1 | 1 | |
53 | 30 | |
- | - | |
6.1 | 3.9 | |
about 1 month ago | 11 months ago | |
Python | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llm-replicate
-
Accessing Llama 2 from the command-line with the LLM-replicate plugin
More about my LLM tool (and Python library) here: https://llm.datasette.io/
Here's the full implementation of that llm-replicate plugin: https://github.com/simonw/llm-replicate/blob/0.2/llm_replica...
If you want to write a plugin for some other LLM I have a detailed tutorial here: https://llm.datasette.io/en/stable/plugins/tutorial-model-pl... - plus a bunch of examples linked from here: https://github.com/simonw/llm-plugins
llm-mpt30b
-
Accessing Llama 2 from the command-line with the LLM-replicate plugin
My LLM tool can be used for both. That's what the plugins are for.
It can talk to OpenAI, PaLM 2 and Llama / other models on Replicate via API, using API keys.
It can run local models on your own machine using these two plugins: https://github.com/simonw/llm-gpt4all and https://github.com/simonw/llm-mpt30b
What are some alternatives?
llm - Access large language models from the command-line
llm-gpt4all - Plugin for LLM adding support for the GPT4All collection of models
gpt4all - gpt4all: run open-source LLMs anywhere
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
ggml - Tensor library for machine learning
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
guidance - A guidance language for controlling large language models.
llm-plugins - The LLM plugins directory