signal-aichat
promptfoo
signal-aichat | promptfoo | |
---|---|---|
6 | 20 | |
72 | 2,921 | |
- | 23.7% | |
7.3 | 9.9 | |
25 days ago | about 21 hours ago | |
Python | TypeScript | |
GNU Affero General Public License v3.0 | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
signal-aichat
- AI Applications/tools with OpenAI API support? [Examples]
-
Looking for self-hosted tools with OpenAI API support
I released a chatbot for Signal the other day that supports ChatGPT and local llama.cpp models via the OpenAI API. Bing Chat works as well, but that's a separate API.
-
Weekly Megathread
https://github.com/cycneuramus/signal-aichat - An AI chatbot for Signal powered by Bing Chat, ChatGPT, and llama.cpp
- cycneuramus/signal-aichat: An AI chatbot for Signal powered by Bing Chat, ChatGPT, and llama.cpp
- signal-aichat: Chatbot for Signal with support for llama.cpp compatible LLM's (and ChatGPT, Bing Chat)
- signal-aichat: Hit up your selfhosted LLM models (or ChatGPT, or Bing Chat) directly from Signal
promptfoo
- Google CodeGemma: Open Code Models Based on Gemma [pdf]
- AI Infrastructure Landscape
- Promptfoo – Testing and Evaluation for LLMs
-
Show HN: Prompt-Engineering Tool: AI-to-AI Testing for LLM
Super interesting. We've been experimenting with [promptfoo](https://github.com/promptfoo/promptfoo) at my work, and this looks very similar.
- GitHub – promptfoo/promptfoo: Test your prompts
-
I asked 60 LLMs a set of 20 questions
In case anyone's interested in running their own benchmark across many LLMs, I've built a generic harness for this at https://github.com/promptfoo/promptfoo.
I encourage people considering LLM applications to test the models on their _own data and examples_ rather than extrapolating general benchmarks.
This library supports OpenAI, Anthropic, Google, Llama and Codellama, any model on Replicate, and any model on Ollama, etc. out of the box. As an example, I wrote up an example benchmark comparing GPT model censorship with Llama models here: https://promptfoo.dev/docs/guides/llama2-uncensored-benchmar.... Hope this helps someone.
- Ask HN: Prompt Manager for Developers
- DeepEval – Unit Testing for LLMs
- Show HN: Knit – A Better LLM Playground
- Show HN: CLI for testing and evaluating LLM outputs
What are some alternatives?
yal-discord-bot - Yet Another LLaMA/ALPACA Discord Bot
shap-e - Generate 3D objects conditioned on text or images
Auto-GPT-Plugins - Plugins for Auto-GPT
prompt-engineering - Tips and tricks for working with Large Language Models like OpenAI's GPT-4.
chat-llama-discord-bot - A Discord Bot for chatting with LLaMA, Vicuna, Alpaca, MPT, or any other Large Language Model (LLM) supported by text-generation-webui or llama.cpp.
WizardLM - Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder and WizardMath
nsfw-prompt-detection-sd - NSFW Prompt Detection for Stable Diffusion
chat-ui - Open source codebase powering the HuggingChat app
realtime-bakllava - llama.cpp with BakLLaVA model describes what does it see
litellm - Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)
ChainForge - An open-source visual programming environment for battle-testing prompts to LLMs.