openplayground
LocalAI
openplayground | LocalAI | |
---|---|---|
12 | 84 | |
6,128 | 21,118 | |
- | 7.2% | |
0.6 | 9.9 | |
24 days ago | 3 days ago | |
TypeScript | C++ | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
openplayground
-
Show HN: Unified access to top AI models, supporting GPT4, Claude and more
https://github.com/nat/openplayground
I load up $5 into my account using my credit card and then reload it whenever it gets low, it also has a tab for comparing multiple resulta from different models together.
-
I love how many people want a way bigger context window for example for GPT-4 (like 100k-1m). May I introduce you the cost of one API call at the full 32k context window? 2$. So 1m would approximately cost you 60$. One call. 60$.
https://github.com/nat/openplayground https://discord.gg/uT98U9HJ.
-
How good is the 100k context model?
Try here: https://github.com/nat/openplayground
-
Performance of GPT-4 vs PaLM 2
From there you have lots of other models: One of the best places to easily start using multiple models is using a multiple model UI program lik GPT4All, there are also some programs that provide access to more models or use different ways of interfacing with them, here are some of what I've found are the best / most popular programs to play around with lots of different models and compare them: LocalAI, text-generation-webui, open playground
- Show HN: Promptfoo – a tool for comparing LLM prompts and models
- Show HN: AI Playground by Vercel Labs
-
What is this subreddit about? I can't tell if its wifaus or locally run LLMs
Here's another interesting engine called AI playground that lets you do side-by-side comparisons of language models based on the same prompts: https://github.com/nat/openplayground
- An LLM playground you can run on your laptop
LocalAI
- Local AI
- LocalAI: Self-hosted OpenAI alternative reaches 2.14.0
- Drop-In Replacement for ChatGPT API
- Voxos.ai – An Open-Source Desktop Voice Assistant
- Ask HN: Set Up Local LLM
- FLaNK Stack Weekly 11 Dec 2023
- Is there any open source app to load a model and expose API like OpenAI?
-
What do you use to run your models?
If you're running this as a server, I would recommend LocalAI https://github.com/mudler/LocalAI
-
OpenAI Switch Kit: Swap OpenAI with any open-source model
LocalAI can do that: https://github.com/mudler/LocalAI
https://localai.io/features/openai-functions/
-
"ChatGPT romanesc"
De inspirație, LocalAI, un replacement la OpenAI. E deja hot pe GitHub.
What are some alternatives?
llama.cpp - LLM inference in C/C++
ollama - Get up and running with Llama 3, Mistral, Gemma, and other large language models.
BetterChatGPT - An amazing UI for OpenAI's ChatGPT (Website + Windows + MacOS + Linux)
gpt4all - gpt4all: run open-source LLMs anywhere
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
llama-cpp-python - Python bindings for llama.cpp
promptfoo - Test your prompts, agents, and RAGs. Use LLM evals to improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
private-gpt - Interact with your documents using the power of GPT, 100% privately, no data leaks
ChatALL - Concurrently chat with ChatGPT, Bing Chat, Bard, Alpaca, Vicuna, Claude, ChatGLM, MOSS, 讯飞星火, 文心一言 and more, discover the best answers
galai - Model API for GALACTICA
FastChat - An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.