fiddler-auditor
GodMode
| fiddler-auditor | GodMode | |
|---|---|---|
| 2 | 7 | |
| 148 | 4,067 | |
| 4.1% | 1.3% | |
| 8.1 | 8.5 | |
| 3 months ago | 11 days ago | |
| Python | TypeScript | |
| GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fiddler-auditor
-
I asked 60 LLMs a set of 20 questions
This is really cool!
I've been using this auditor tool that some friends at Fiddler created: https://github.com/fiddler-labs/fiddler-auditor
They went with a langchain interface for custom Evals which I really like. I am curious to hear if anyone has tried both of these. What's been your key take away for these?
-
I'm looking for good ways to audit the LLM projects I am working on right now.
I have only found a handful of tools that work well. One of my favorite ones is the LLM Auditor by the data science team at Fiddler. Essentially multiplies your ability to run audits on multiple types of models and generate robustness reports.
GodMode
-
Show HN: Heynote – A Dedicated Scratchpad for Developers
ah a fellow electron app publisher! qq - have you figured out automatic updates yet? i tried to do that in my app (https://github.com/smol-ai/GodMode) but everyone just complains about a blank white screen whenever i push an update, if they even receive it at all. feels very flimsy. what do uou recommend for update push best practice?
-
I asked 60 LLMs a set of 20 questions
and i made https://github.com/smol-ai/GodMode that also includes the closed source LLMs
-
Is ChatALL safe?
Yes it's safe, also check out https://github.com/smol-ai/GodMode
-
How to create a Qt 5 ARM/Intel universal binary for Mac
i am currently in Apple code signing and notarizing hell for https://github.com/smol-ai/GodMode :(
-
Dumbar, a Not So Smart Menubar App
niiice - i also worked on an llm menubar app until i added enough that I found myself using it as a secondary browser
https://github.com/smol-ai/GodMode
more approaches the better! i considered adding ollama but no ui and i have a ui centric approach
- Show HN: GodMode – open-source AI Chat Browser
- GodMode – The Smol AI Chat Browser
What are some alternatives?
ChainForge - An open-source visual programming environment for battle-testing prompts to LLMs.
custom-titlebar - Poorly coded titlebar for Electron, NW.js and PWAs
bench - A tool for evaluating LLMs
TheoremQA - The dataset and code for paper: TheoremQA: A Theorem-driven Question Answering dataset
ollama-ui - Simple HTML UI for Ollama
google-waitlist - Sign up for Google's latest AI-powered waitlist today!
ChatALL - Concurrently chat with ChatGPT, Bing Chat, Bard, Alpaca, Vicuna, Claude, ChatGLM, MOSS, 讯飞星火, 文心一言 and more, discover the best answers
evals - Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
promptfoo - Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models with CI/CD integration.