llm-api
Run any Large Language Model behind a unified API (by 1b5d)
llm
Use any LLM from the command line. (by snwfdhmp)
| llm-api | llm | |
|---|---|---|
| 2 | 4 | |
| 147 | 36 | |
| - | - | |
| 6.6 | 8.4 | |
| 7 months ago | 3 months ago | |
| Python | JavaScript | |
| MIT License | GNU General Public License v3.0 or later |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llm-api
Posts with mentions or reviews of llm-api.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-12-09.
-
Is there any open source app to load a model and expose API like OpenAI?
1b5d/llm-api: Run any Large Language Model behind a unified API (github.com)
-
Best local LLM software.
Good question, and an open one. You could try HuggingFace to have a wide variety of options. What is your technical expertise level? If you’re comfortable with python, then HuggingFace might be easier, for JS you could check out https://github.com/snwfdhmp/llm — some models which pop up a lot around here are llama.cpp, https://erichartford.com/uncensored-models - you could try https://github.com/1b5d/llm-api or https://github.com/minimaxir/simpleaichat
llm
Posts with mentions or reviews of llm.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-06-16.
- Simple LLM usage for beginners
-
Concept Of Reusability When Using AI Tools In Daily Tasks/Work
i made a tool for that that can use text files along with variables, can use plugins even on gpt3.5, and some other stuff. https://github.com/snwfdhmp/llm
-
npx llm "Hello world!" is now a thing
I'm excited to share with you a new tool that simplifies the usage of language models from the command line: llm. This tool allows you to manipulate any language model, from simple to advanced usage, directly from your terminal.
-
Best local LLM software.
Good question, and an open one. You could try HuggingFace to have a wide variety of options. What is your technical expertise level? If you’re comfortable with python, then HuggingFace might be easier, for JS you could check out https://github.com/snwfdhmp/llm — some models which pop up a lot around here are llama.cpp, https://erichartford.com/uncensored-models - you could try https://github.com/1b5d/llm-api or https://github.com/minimaxir/simpleaichat
What are some alternatives?
When comparing llm-api and llm you can also consider the following projects:
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
alpaca.cpp-webui - Web UI for Alpaca.cpp - Locally run an Instruction-Tuned Chat-Style LLM
simpleaichat - Python package for easily interfacing with chat apps, with robust features and minimal code complexity.
ChatGPT Auto Refresh - ↻ Keeps ChatGPT sessions fresh to avoid network errors + Cloudflare checks
chicagomoontimes.com - Automated satirical news site providing funny commentary on local and national issues.
DuckDuckGPT - 🐤 DuckDuckGo add-on that brings the magic of ChatGPT to search results (powered by GPT-4!)
chatgpt.js - 🤖 A powerful client-side JavaScript library for ChatGPT