SaaSHub helps you find the best software and product alternatives Learn more →
Local-LLM-Comparison-Colab-UI Alternatives
Similar projects and alternatives to Local-LLM-Comparison-Colab-UI
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
guidance
Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)
-
SillyTavern
Discontinued LLM Frontend for Power Users. [Moved to: https://github.com/SillyTavern/SillyTavern] (by Cohee1207)
-
exllama
A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
-
open_llama
OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
WizardLM
Discontinued Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder and WizardMath
-
llm-jeopardy
Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
-
azure-search-openai-demo
A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.
-
langflow
⛓️ Langflow is a dynamic graph where each node is an executable unit. Its modular and interactive design fosters rapid experimentation and prototyping, pushing hard on the limits of creativity.
-
alpaca_eval
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Local-LLM-Comparison-Colab-UI reviews and mentions
- Mistral 7B OpenOrca outclasses Llama 2 13B variants
-
GPT-4 API general availability
In terms of speed, we're talking about 140t/s for 7B models, and 40t/s for 33B models on a 3090/4090 now.[1] (1 token ~= 0.75 word) It's quite zippy. llama.cpp performs close on Nvidia GPUs now (but they don't have a handy chart) and you can get decent performance on 13B models on M1/M2 Macs.
You can take a look at a list of evals here: https://llm-tracker.info/books/evals/page/list-of-evals - for general usage, I think home-rolled evals like llm-jeopardy [2] and local-llm-comparison [3] by hobbyists are more useful than most of the benchmark rankings.
That being said, personally I mostly use GPT-4 for code assistance to that's what I'm most interested in, and the latest code assistants are scoring quite well: https://github.com/abacaj/code-eval - a recent replit-3b fine tune the human-eval results for open models (as a point of reference, GPT-3.5 gets 60.4 on pass@1 and 68.9 on pass@10 [4]) - I've only just started playing around with it since replit model tooling is not as good as llamas (doc here: https://llm-tracker.info/books/howto-guides/page/replit-mode...).
I'm interested in potentially applying reflexion or some of the other techniques that have been tried to even further increase coding abilities. (InterCode in particular has caught my eye https://intercode-benchmark.github.io/)
[1] https://github.com/turboderp/exllama#results-so-far
[2] https://github.com/aigoopy/llm-jeopardy
[3] https://github.com/Troyanovsky/Local-LLM-comparison/tree/mai...
[4] https://github.com/nlpxucan/WizardLM/tree/main/WizardCoder
-
Best 7B model
The best 7B I tried is WizardLM. It's my go-to model.
-
UltraLM-13B reaches top of AlpacaEval leaderboard
If you want to try it out, you can use Google Colab here with Oobabooga Text Generation UI: Link (Remember to check the instruction template and generation parameters)
-
wizardLM-7B.q4_2
I'm really impressed by wizardLM-7B.q4_2 (GPT4all) running on my 8gb M2 Mac Air. Fast response, fewer hallucinations than other 7B models I've tried. GPT4All's beta document collection and query function is respectable--going to test it more tomorrow. FWIW wizardLM-7B.q4_2 was ranked very high here https://github.com/Troyanovsky/Local-LLM-comparison.
-
Help me discover new LLMs for school project
I made a series of Colab notebooks for different models: https://github.com/Troyanovsky/Local-LLM-comparison
-
Nous Hermes 13b is very good.
I found it performing very well too in my testing (Repo). It's my second favorite model after WizardLM-13B.
- How to train 7B models with small documents?
-
What are your favorite LLMs?
My entire list at: Local LLM Comparison Repo
-
Announcing Nous-Hermes-13b (info link in thread)
I just tried HyperMantis and updated the results in the repo. It performs not bad but worse than Nous-Hermes-13B.
-
A note from our sponsor - SaaSHub
www.saashub.com | 2 May 2024
Stats
The primary programming language of Local-LLM-Comparison-Colab-UI is Jupyter Notebook.
Popular Comparisons
- Local-LLM-Comparison-Colab-UI VS langflow
- Local-LLM-Comparison-Colab-UI VS private-gpt
- Local-LLM-Comparison-Colab-UI VS simple-proxy-for-tavern
- Local-LLM-Comparison-Colab-UI VS GPTQ-for-LLaMa
- Local-LLM-Comparison-Colab-UI VS koboldcpp
- Local-LLM-Comparison-Colab-UI VS alpaca_eval
- Local-LLM-Comparison-Colab-UI VS can-ai-code
- Local-LLM-Comparison-Colab-UI VS starcoder
- Local-LLM-Comparison-Colab-UI VS UltraChat
- Local-LLM-Comparison-Colab-UI VS llm-jeopardy
Sponsored