So there's this thing, FreedomGPT.

• koboldcpp

  180 4,015 10.0 C++

  A simple one-file way to run various GGML and GGUF models with KoboldAI's UI

Well, can it get any easier than with koboldcpp? Download the .exe, drag and drop a ggml model file onto it, and you get a powerful web UI in your browser to interact with your model.

• text-generation-webui

  876 37,023 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Or use the 1-click installer for oobabooga's text-generation-webui. Even includes a model downloader.

• SurveyJS

  surveyjs.io featured

  Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

  

• FreedomGPT

  11 2,553 8.9 TypeScript

  This codebase is for a React and Electron-based app that executes the FreedomGPT LLM locally (offline and private) on Mac and Windows using a chat-based interface

  

Here's the github repository if you want to look under the hood: https://github.com/ohmplatform/FreedomGPT

• Visual Studio Code

  2,862 158,946 10.0 TypeScript

  Visual Studio Code

  

If you store your models in subfolders of the koboldcpp folder, just create a plain text file (with notepad.exe or better VSCode) with .bat or .cmd ending, and put the command you want to use inside - e. g. for WizardLM-7B-uncensored (which I placed in the subfolder TheBloke_WizardLM-7B-uncensored-GGML):

Suggest a related project