ollama-ui
ggml
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ollama-ui
-
Dumbar, a Not So Smart Menubar App
This is great. I was thinking about putting something like this together for personal use, so - thanks for saving us the trouble!
Ollama support would be amazing, especially with the recent integration of codellama and phind-codellama. I’m sure you’re aware, but for the benefit of anyone else: there is a third party Ollama web ui[1] linked to from the ollama project homepage. It’s barebones, but does the trick.
[1]: https://github.com/ollama-ui/ollama-ui
- Meta: Code Llama, an AI Tool for Coding
ggml
-
Run LLMs at home, BitTorrent‑style
https://github.com/philpax/ggml/blob/gguf-spec/docs/gguf.md#...
It is (IMO) a necessary and good change.
I just specified gguf because my 3090 cannot host a 70B model without offloading outside of exLlama's very new ~2 bit quantization.
- GGUF File Format Specification
-
Meta: Code Llama, an AI Tool for Coding
While we're at it, the GGML file format has been deprecated in favor of GGUF.
https://github.com/philpax/ggml/blob/gguf-spec/docs/gguf.md
https://github.com/ggerganov/llama.cpp/pull/2398
What are some alternatives?
aider - aider is AI pair programming in your terminal
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
llama.cpp - LLM inference in C/C++
chat.petals.dev - 💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client
Dumbar - A smrt, no, smart, ok, no dumb smartbar for Ollama
smartcat
tabby - Self-hosted AI coding assistant
LoRA - Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"
godot-dodo - Finetuning large language models for GDScript generation.
codellama - Inference code for CodeLlama models