SecondShiftAugie
promptfoo
SecondShiftAugie | promptfoo | |
---|---|---|
6 | 20 | |
11 | 2,921 | |
- | 23.7% | |
6.5 | 9.9 | |
about 1 year ago | 1 day ago | |
Python | TypeScript | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
SecondShiftAugie
-
Weekly summary - 21 May 2023
https://github.com/AugustWasilowski/SecondShiftAugie created by u/MayorAwesome
- Weekly Megathread - 14 May 2023
-
Weekly Megathread
https://github.com/AugustWasilowski/SecondShiftAugie - Second Shift Augie is a sassy and sarcastic AI assistant that helps answer questions and summarize YouTube videos. It uses the discord.py library for interacting with the Discord API and has several different features, including text-to-speech functionality. Made by u/MayorAwesome
- Second Shift Augie: AI-Packed Discord Bot, Open source project, looking for contributors and testers.
-
How to add slash commands to code running inside cogs?
This is for my AI chatbot Second Shift Augie. Here's the repo: https://github.com/AugustWasilowski/SecondShiftAugie
- I made a discord bot that connects to ChatGPT, Wolfram Alpha, SerapApi, and can summarize YouTube videos. Anyone want to help me develop it?
promptfoo
- Google CodeGemma: Open Code Models Based on Gemma [pdf]
- AI Infrastructure Landscape
- Promptfoo â Testing and Evaluation for LLMs
-
Show HN: Prompt-Engineering Tool: AI-to-AI Testing for LLM
Super interesting. We've been experimenting with [promptfoo](https://github.com/promptfoo/promptfoo) at my work, and this looks very similar.
- GitHub â promptfoo/promptfoo: Test your prompts
-
I asked 60 LLMs a set of 20 questions
In case anyone's interested in running their own benchmark across many LLMs, I've built a generic harness for this at https://github.com/promptfoo/promptfoo.
I encourage people considering LLM applications to test the models on their _own data and examples_ rather than extrapolating general benchmarks.
This library supports OpenAI, Anthropic, Google, Llama and Codellama, any model on Replicate, and any model on Ollama, etc. out of the box. As an example, I wrote up an example benchmark comparing GPT model censorship with Llama models here: https://promptfoo.dev/docs/guides/llama2-uncensored-benchmar.... Hope this helps someone.
- Ask HN: Prompt Manager for Developers
- DeepEval â Unit Testing for LLMs
- Show HN: Knit â A Better LLM Playground
- Show HN: CLI for testing and evaluating LLM outputs
What are some alternatives?
SD-CN-Animation - This script allows to automate video stylization task using StableDiffusion and ControlNet.
shap-e - Generate 3D objects conditioned on text or images
StableStudio - Community interface for generative AI
prompt-engineering - Tips and tricks for working with Large Language Models like OpenAI's GPT-4.
PaLM - An open-source implementation of Google's PaLM models
WizardLM - Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder and WizardMath
threestudio - A unified framework for 3D content generation.
chat-ui - Open source codebase powering the HuggingChat app
pezzo - đšī¸ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.
litellm - Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)
VPGTrans - Codes for VPGTrans: Transfer Visual Prompt Generator across LLMs. VL-LLaMA, VL-Vicuna.
ChainForge - An open-source visual programming environment for battle-testing prompts to LLMs.