LocalAI
mods
| LocalAI | mods | |
|---|---|---|
| 83 | 11 | |
| 19,862 | 2,405 | |
| 8.3% | 4.4% | |
| 9.9 | 9.0 | |
| 4 days ago | 3 days ago | |
| C++ | Go | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
LocalAI
- LocalAI: Self-hosted OpenAI alternative reaches 2.14.0
- Drop-In Replacement for ChatGPT API
- Voxos.ai – An Open-Source Desktop Voice Assistant
- Ask HN: Set Up Local LLM
- FLaNK Stack Weekly 11 Dec 2023
- Is there any open source app to load a model and expose API like OpenAI?
-
What do you use to run your models?
If you're running this as a server, I would recommend LocalAI https://github.com/mudler/LocalAI
-
OpenAI Switch Kit: Swap OpenAI with any open-source model
LocalAI can do that: https://github.com/mudler/LocalAI
https://localai.io/features/openai-functions/
-
"ChatGPT romanesc"
De inspirație, LocalAI, un replacement la OpenAI. E deja hot pe GitHub.
-
Local LLM's to run on old iMac / Hardware
Your hardware should be fine for inferencing, as long as you don't bother trying to get the GPU working.
My $0.02 would be to try getting LocalAI running on your machine with OpenCL/CLBlas acceleration for your CPU. If you're running other things, you could limit the inferencing process to 2 or 3 threads. That should get it working; I've been able to inference even 13b models on cheap Rockchip SOCs. Your CPU should be fine, even if it's a little outdated.
LocalAI: https://github.com/mudler/LocalAI
Some decent models to start with:
TinyLlama (extremely small/fast): https://huggingface.co/TheBloke/TinyLlama-1.1B-Chat-v0.3-GGU...
Dolphin Mistral (larger size, better responses: https://huggingface.co/TheBloke/dolphin-2.1-mistral-7B-GGUF
mods
-
Essential Command Line Tools for Developers
View on GitHub
- AI on the Command Line
-
LocalAI v1.18.0 release!
Mods
- FLaNK Stack 5-June-2023
- Mods adds support for LocalAI
-
LLM, ttok and strip-tags–CLI tools for working with ChatGPT and other LLMs
Another enthusiastic vote for https://github.com/charmbracelet/mods - this is precisely the UX I was looking and waiting for - the day that I cloned it and started using it within my terminal was the day I no longer needed to even window out to firefox - and it feels very natural to compose with pipes, wrap into shell scripts, etc.
Early days, but you can see some of the ways this is already helping me out quite a bit (and increasing my enjoyment of things I already like to do): github.com/zackproser/automations
- Mods: AI for the command line built with Bubble Tea and Go
- GPT for command line pipelines
- ChatGPT on the command line
What are some alternatives?
gpt4all - gpt4all: run open-source LLMs anywhere
wizapp - The Wizard's Apprentice, an AI-powered Typescript project functionality suite with CLI.
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
butterfish - A shell with AI superpowers
llama-cpp-python - Python bindings for llama.cpp
bashGPT - Use ChatGPT, GPT-3 and other models from the command line.
private-gpt - Interact with your documents using the power of GPT, 100% privately, no data leaks
chat_term - fast terminal access to ChatGPT
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
shell_gpt - A command-line productivity tool powered by AI large language models like GPT-4, will help you accomplish your tasks faster and more efficiently.
FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
thoughtloom - ThoughtLoom is a powerful tool designed to foster creativity and enhance productivity through the use of LLMs directly from the command line. It facilitates rapid development and integration of LLM-based tools into various workflows, empowering individuals and teams to experiment, collaborate, and ultimately streamline their daily tasks.