-
ollama
Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
You need ollama[1][2] and hardware to run 20-70B models with quantization of Q4 at least to have similar experience to commercially hosted models. I use codestral:22b, gemma2:27b, gemma2:27b-instruct, aya:35b.
Smaller models are useless for me, because my native language is Ukrainian (it's easier to spot mistakes made by model in a language with more complex grammar rules).
As GUI, I use Page Assist[3] plugin for Firefox, or aichat[4] commandline and WebUI tool.
[1]: https://github.com/ollama/ollama/releases
[2]: https://ollama.com/
[3]: https://github.com/n4ze3m/page-assist
[4]: https://github.com/sigoden/aichat
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
You need ollama[1][2] and hardware to run 20-70B models with quantization of Q4 at least to have similar experience to commercially hosted models. I use codestral:22b, gemma2:27b, gemma2:27b-instruct, aya:35b.
Smaller models are useless for me, because my native language is Ukrainian (it's easier to spot mistakes made by model in a language with more complex grammar rules).
As GUI, I use Page Assist[3] plugin for Firefox, or aichat[4] commandline and WebUI tool.
[1]: https://github.com/ollama/ollama/releases
[2]: https://ollama.com/
[3]: https://github.com/n4ze3m/page-assist
[4]: https://github.com/sigoden/aichat
-
aichat
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
You need ollama[1][2] and hardware to run 20-70B models with quantization of Q4 at least to have similar experience to commercially hosted models. I use codestral:22b, gemma2:27b, gemma2:27b-instruct, aya:35b.
Smaller models are useless for me, because my native language is Ukrainian (it's easier to spot mistakes made by model in a language with more complex grammar rules).
As GUI, I use Page Assist[3] plugin for Firefox, or aichat[4] commandline and WebUI tool.
[1]: https://github.com/ollama/ollama/releases
[2]: https://ollama.com/
[3]: https://github.com/n4ze3m/page-assist
[4]: https://github.com/sigoden/aichat
Related posts
-
Fast and secure ingress to remote AIs with ngrok, Deepseek, and Ollama
-
Show HN: Onit – open-source ChatGPT Desktop with local mode, Claude, Gemini
-
Building a Multi-Agent Hiring Workflow with LangChain4j and LangGraph4j on Spring Boot
-
I Built a $0 Local AI Automation Stack: Agentic Coding + Market Data Over MCP
-
Adding Gemma 4 speech recognition to a .NET desktop app: the llama-server sidecar that survived