Koboldcpp-rocm Alternatives

Similar projects and alternatives to koboldcpp-rocm

• text-generation-webui

  876 36,552 9.9 Python koboldcpp-rocm VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  773 57,463 10.0 C++ koboldcpp-rocm VS llama.cpp

  LLM inference in C/C++

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• ollama

  199 62,615 9.9 Go koboldcpp-rocm VS ollama

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

• koboldcpp

  180 3,817 10.0 C++ koboldcpp-rocm VS koboldcpp

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

• mlc-llm

  89 16,955 9.9 Python koboldcpp-rocm VS mlc-llm

  Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

  

• web-llm

  43 9,102 9.1 TypeScript koboldcpp-rocm VS web-llm

  Bringing large-language models and chat to web browsers. Everything runs inside the browser with no server support.

  

• triton

  30 11,054 9.9 C++ koboldcpp-rocm VS triton

  Development repository for the Triton language and compiler

  

• SaaSHub

  www.saashub.com featured

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

  

• cody

  22 1,942 9.9 TypeScript koboldcpp-rocm VS cody

  AI that knows your entire codebase

  

• TensorRT

  22 9,110 5.0 C++ koboldcpp-rocm VS TensorRT

  NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

  

• flake

  5 593 4.4 Nix koboldcpp-rocm VS flake

  A Nix flake for many AI projects

  

• Dumbar

  2 51 4.6 JavaScript koboldcpp-rocm VS Dumbar

  A smrt, no, smart, ok, no dumb smartbar for Ollama

• nix-stable-diffusion

  2 107 5.5 Nix koboldcpp-rocm VS nix-stable-diffusion

  Flake for running SD on NixOS

• gpt4all-nix

  1 37 10.0 Nix koboldcpp-rocm VS gpt4all-nix

  Discontinued Nix flake for gpt4all