Ggml Alternatives

Similar projects and alternatives to ggml

• text-generation-webui

  876 35,862 9.9 Python ggml VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  769 55,846 10.0 C++ ggml VS llama.cpp

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Open-Assistant

  329 36,622 9.1 Python ggml VS Open-Assistant

  OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

  

• whisper.cpp

  187 30,942 9.8 C ggml VS whisper.cpp

  Port of OpenAI's Whisper model in C/C++

• koboldcpp

  180 3,749 10.0 C++ ggml VS koboldcpp

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• gpt4all

  139 64,046 9.8 C++ ggml VS gpt4all

  gpt4all: run open-source LLMs anywhere

  

• alpaca-lora

  107 18,167 3.6 Jupyter Notebook ggml VS alpaca-lora

  Instruct-tune LLaMA on consumer hardware

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• petals

  98 8,661 8.5 Python ggml VS petals

  🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

  

• mlc-llm

  89 16,774 9.9 Python ggml VS mlc-llm

  Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

  

• RWKV-LM

  84 11,619 8.8 Python ggml VS RWKV-LM

  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

• open_llama

  52 7,193 5.3 ggml VS open_llama

  OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

  

• StableLM

  43 15,853 5.0 Jupyter Notebook ggml VS StableLM

  StableLM: Stability AI Language Models

  

• llm

  41 5,885 9.4 Rust ggml VS llm

  An ecosystem of Rust libraries for working with large language models

  

• dolly

  41 10,784 7.2 Python ggml VS dolly

  Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

  

• lm-evaluation-harness

  34 4,957 9.9 Python ggml VS lm-evaluation-harness

  A framework for few-shot evaluation of language models.

  

• Whisper

  32 7,126 6.5 C++ ggml VS Whisper

  High-performance GPGPU inference of OpenAI's Whisper automatic speech recognition (ASR) model (by Const-me)

• GLM-130B

  19 7,607 4.8 Python ggml VS GLM-130B

  GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

  

• FlexGen

  19 5,350 10.0 Python ggml VS FlexGen

  Discontinued Running large language models like OPT-175B/GPT-3 on a single GPU. Focusing on high-throughput generation. [Moved to: https://github.com/FMInference/FlexGen] (by Ying1123)

  

• RedPajama-Data

  19 4,329 6.0 Python ggml VS RedPajama-Data

  The RedPajama-Data repository contains code for preparing large datasets for training large language models.

  

• alpaca.cpp

  94 9,878 9.4 C ggml VS alpaca.cpp

  Discontinued Locally run an Instruction-Tuned Chat-Style LLM

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives