llamacpp-python
openplayground
| llamacpp-python | openplayground | |
|---|---|---|
| 3 | 12 | |
| 197 | 6,128 | |
| - | - | |
| 6.6 | 0.6 | |
| about 1 year ago | 24 days ago | |
| C++ | TypeScript | |
| - | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llamacpp-python
- An LLM playground you can run on your laptop
-
llama.cpp support has been added!
This was contributed by @thomasantony and made possible by his llamacpp-python library.
- Show HN: Python Bindings for llama.cpp with some CLIs
openplayground
-
Show HN: Unified access to top AI models, supporting GPT4, Claude and more
https://github.com/nat/openplayground
I load up $5 into my account using my credit card and then reload it whenever it gets low, it also has a tab for comparing multiple resulta from different models together.
-
I love how many people want a way bigger context window for example for GPT-4 (like 100k-1m). May I introduce you the cost of one API call at the full 32k context window? 2$. So 1m would approximately cost you 60$. One call. 60$.
https://github.com/nat/openplayground https://discord.gg/uT98U9HJ.
-
How good is the 100k context model?
Try here: https://github.com/nat/openplayground
-
Performance of GPT-4 vs PaLM 2
From there you have lots of other models: One of the best places to easily start using multiple models is using a multiple model UI program lik GPT4All, there are also some programs that provide access to more models or use different ways of interfacing with them, here are some of what I've found are the best / most popular programs to play around with lots of different models and compare them: LocalAI, text-generation-webui, open playground
- Show HN: Promptfoo – a tool for comparing LLM prompts and models
- Show HN: AI Playground by Vercel Labs
-
What is this subreddit about? I can't tell if its wifaus or locally run LLMs
Here's another interesting engine called AI playground that lets you do side-by-side comparisons of language models based on the same prompts: https://github.com/nat/openplayground
- An LLM playground you can run on your laptop
What are some alternatives?
awesome-ml - Curated list of useful LLM / Analytics / Datascience resources
llama.cpp - LLM inference in C/C++
text-generation-webui - A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
BetterChatGPT - An amazing UI for OpenAI's ChatGPT (Website + Windows + MacOS + Linux)
promptfoo - Test your prompts, agents, and RAGs. Use LLM evals to improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.
ChatALL - Concurrently chat with ChatGPT, Bing Chat, Bard, Alpaca, Vicuna, Claude, ChatGLM, MOSS, 讯飞星火, 文心一言 and more, discover the best answers
galai - Model API for GALACTICA
gpt-edge-test
LoRA - Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"