Model 8bit Optimization Through WSL

This page summarizes the projects mentioned and recommended in the original post on /r/PygmalionAI

InfluxDB
Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • KoboldAI-Client

    • Install KoboldAI in WSL: git clone https://github.com/KoboldAI/KoboldAI-Client sh play.sh (This will update everything and do a general install on first run. Further install details can be found on the KoboldAI github.)

  • KoboldAI

    • Go to the aiserver.py file in the united fork of KoboldAI here: https://github.com/henk717/KoboldAI/blob/united/aiserver.py Replace the contents of ‘model_menu = {}’ in aiserver.py with the contents of the united forks version. (This is optional but will give you access to more models, for example the Pygmalion chat ones.)

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • anaconda-issues

    Anaconda issue tracking

  • text-generation-webui

    A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

    • Follow the installation instructions here for oobabooga’s webui: https://github.com/oobabooga/text-generation-webui (After you need to activate your conda env whenever you reopen the terminal to start server.py)

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts