Local-LLM-Comparison-Colab-UI

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI. (by Troyanovsky)

Local-LLM-Comparison-Colab-UI Alternatives

Similar projects and alternatives to Local-LLM-Comparison-Colab-UI

Troyanovsky
Local-LLM-Comparison-Colab-UI
  1. llama.cpp

    LLM inference in C/C++

  2. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  3. koboldcpp

    Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

  4. private-gpt

    Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference server.

  5. guidance

    Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)

  6. SillyTavern

    Discontinued LLM Frontend for Power Users. [Moved to: https://github.com/SillyTavern/SillyTavern] (by Cohee1207)

  7. exllama

    A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.

  8. chat-ui

    The open source codebase powering HuggingChat

  9. open_llama

    OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

  10. developer

    the first library to let you embed a developer agent in your own app!

  11. WizardLM

    Discontinued Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder and WizardMath

  12. can-ai-code

    Self-evaluating interview for AI coders

  13. simple-proxy-for-tavern

    Discontinued [GET https://api.github.com/repos/anon998/simple-proxy-for-tavern: 404 - Not Found // See: https://docs.github.com/rest/repos/repos#get-a-repository]

  14. open-llms

    📋 A list of open LLMs available for commercial use.

  15. GPTQ-for-LLaMa

    4 bits quantization of LLaMa using GPTQ (by oobabooga)

  16. starcoder

    Home of StarCoder: fine-tuning & inference!

  17. llm-jeopardy

    Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts

  18. azure-search-openai-demo

    A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.

  19. langflow

    Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

  20. alpaca_eval

    An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

  21. LLMBenchMark

    Like system requirements lab but for LLMs

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better Local-LLM-Comparison-Colab-UI alternative or higher similarity.

Local-LLM-Comparison-Colab-UI discussion

Log in or Post with

Local-LLM-Comparison-Colab-UI reviews and mentions

Posts with mentions or reviews of Local-LLM-Comparison-Colab-UI. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-07-06.

Stats

Basic Local-LLM-Comparison-Colab-UI repo stats
20
1,100
7.7
7 months ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com

Did you know that Jupyter Notebook is
the 15th most popular programming language
based on number of references?