Help me discover new LLMs for school project

• llama.cpp

  776 57,463 10.0 C++

  LLM inference in C/C++

You can try llama.cpp or KoboldCPP for CPU infererece. Or you can try online demo like HuggingChat or Selfee.

• chat-ui

  40 6,250 9.7 TypeScript

  Open source codebase powering the HuggingChat app

  

You can try llama.cpp or KoboldCPP for CPU infererece. Or you can try online demo like HuggingChat or Selfee.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• koboldcpp

  180 3,887 10.0 C++

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

You can try llama.cpp or KoboldCPP for CPU infererece. Or you can try online demo like HuggingChat or Selfee.

• Local-LLM-Comparison-Colab-UI

  20 886 9.1 Jupyter Notebook

  Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

I made a series of Colab notebooks for different models: https://github.com/Troyanovsky/Local-LLM-comparison

Suggest a related project