Performance of GPT-4 vs PaLM 2

• Awesome-LLM

  10 14,654 8.6

  Awesome-LLM: a curated list of Large Language Model

First this is a pretty good starting point as a resource for learning about and finding open source models and the overall public history of progress of LLMs.

• llama.cpp

  780 57,984 10.0 C++

  LLM inference in C/C++

Gerganov in his own words build the first version of llama.ccp which initially ran using a macbook CPU was "hacked together in one evening".

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• LoRA

  34 9,172 4.7 Python

  Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

  

Using LoRA and a RTX 4090 it only took a few hours to train a new model with comparable output similar to Alpaca

• alpaca-lora

  107 18,238 3.6 Jupyter Notebook

  Instruct-tune LLaMA on consumer hardware

Using LoRA and a RTX 4090 it only took a few hours to train a new model with comparable output similar to Alpaca

• gpt4all

  139 65,076 9.8 C++

  gpt4all: run open-source LLMs anywhere

  

From there you have lots of other models: One of the best places to easily start using multiple models is using a multiple model UI program lik GPT4All, there are also some programs that provide access to more models or use different ways of interfacing with them, here are some of what I've found are the best / most popular programs to play around with lots of different models and compare them: LocalAI, text-generation-webui, open playground

• LocalAI

  83 20,346 9.9 C++

  :robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

  

From there you have lots of other models: One of the best places to easily start using multiple models is using a multiple model UI program lik GPT4All, there are also some programs that provide access to more models or use different ways of interfacing with them, here are some of what I've found are the best / most popular programs to play around with lots of different models and compare them: LocalAI, text-generation-webui, open playground

• text-generation-webui

  876 36,827 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

From there you have lots of other models: One of the best places to easily start using multiple models is using a multiple model UI program lik GPT4All, there are also some programs that provide access to more models or use different ways of interfacing with them, here are some of what I've found are the best / most popular programs to play around with lots of different models and compare them: LocalAI, text-generation-webui, open playground

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• openplayground

  12 6,099 2.0 TypeScript

  An LLM playground you can run on your laptop

From there you have lots of other models: One of the best places to easily start using multiple models is using a multiple model UI program lik GPT4All, there are also some programs that provide access to more models or use different ways of interfacing with them, here are some of what I've found are the best / most popular programs to play around with lots of different models and compare them: LocalAI, text-generation-webui, open playground

• Open-Assistant

  329 36,699 8.3 Python

  OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

  

And last but not least check out open assistant , it's a pretty good chat bot too.

Suggest a related project