portainer-templates
LocalAI
| portainer-templates | LocalAI | |
|---|---|---|
| 14 | 83 | |
| 1,514 | 19,862 | |
| - | 8.3% | |
| 9.0 | 9.9 | |
| 3 days ago | 6 days ago | |
| Python | C++ | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
portainer-templates
- Is it worth upgrading the RAM/CPU on my micro optiplex 7050 to use for a home server?
- +500 Portainer template + multi URL templates
- M1 Mini left to spare, what homeserver applications shall i run on this?
- I graduated from homelab to datacenter. Looking for more ideas on how to use my rack.
- It starts
-
What do you think of this setup for a 16yo?
and this if You run docker : https://github.com/Lissy93/portainer-templates
- Seft-host VPNs recommendation regarding power efficiency
- Media center, powerful fun and cheap
-
My ‘Home Lab’
Some helpfull scripts for start : tteck.github.io/Proxmox/ • Get/ install Synology as Your NAS (r/xpenology) • ( guide https://www.wundertech.net/how-to-install-xpenology-on-proxmox-dsm-7/ ) i could help You with bootloader build and after setup so disks are seen • absolutely install docker Container using that link on github + portainer and then add this golden gem : • + https://github.com/Lissy93/portainer-templates
LocalAI
- LocalAI: Self-hosted OpenAI alternative reaches 2.14.0
- Drop-In Replacement for ChatGPT API
- Voxos.ai – An Open-Source Desktop Voice Assistant
- Ask HN: Set Up Local LLM
- FLaNK Stack Weekly 11 Dec 2023
- Is there any open source app to load a model and expose API like OpenAI?
-
What do you use to run your models?
If you're running this as a server, I would recommend LocalAI https://github.com/mudler/LocalAI
-
OpenAI Switch Kit: Swap OpenAI with any open-source model
LocalAI can do that: https://github.com/mudler/LocalAI
https://localai.io/features/openai-functions/
-
"ChatGPT romanesc"
De inspirație, LocalAI, un replacement la OpenAI. E deja hot pe GitHub.
-
Local LLM's to run on old iMac / Hardware
Your hardware should be fine for inferencing, as long as you don't bother trying to get the GPU working.
My $0.02 would be to try getting LocalAI running on your machine with OpenCL/CLBlas acceleration for your CPU. If you're running other things, you could limit the inferencing process to 2 or 3 threads. That should get it working; I've been able to inference even 13b models on cheap Rockchip SOCs. Your CPU should be fine, even if it's a little outdated.
LocalAI: https://github.com/mudler/LocalAI
Some decent models to start with:
TinyLlama (extremely small/fast): https://huggingface.co/TheBloke/TinyLlama-1.1B-Chat-v0.3-GGU...
Dolphin Mistral (larger size, better responses: https://huggingface.co/TheBloke/dolphin-2.1-mistral-7B-GGUF
What are some alternatives?
self-hosted-template
gpt4all - gpt4all: run open-source LLMs anywhere
Docker Compose - Define and run multi-container applications with Docker
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
arc - Arc is a customized Redpill Loader for DSM 7.x (Xpenology) with enhanced Hardwaresupport, Addons, guided (semi-automated) Installation and more. Multiple customization options are built-in. It is modified to run on different Hardware (Wiki for more Informations). Commercial use is not permitted and strictly forbidden!
llama-cpp-python - Python bindings for llama.cpp
Proxmox - Proxmox VE Helper-Scripts
private-gpt - Interact with your documents using the power of GPT, 100% privately, no data leaks
portainer-templates-Nov-2022-collection - A collection of 488 templates for Portainer v2.0 sourced from various repositories
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
templates - Portainer Templates, mostly based off of linuxserver.io
FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.