KoboldAI 1.17 - The Great Migration

This page summarizes the projects mentioned and recommended in the original post on /r/KoboldAI

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • KoboldAI

    At the time of the screenshot I was using the KoboldAI/fairseq-dense-2.7B model and the latest development version of both KoboldAI (United) and Transformers (probably after the commit that fixes newlines).

  • KoboldAI-Client

    This is one of the biggest changes this release, KoboldAI now has its own Lua scripting engine on board with a documented API and various examples. This allows you to do some powerful customization, such as making the AI avoid the usage of the word You. Automatically updating World Info entries, word replacements, word banning and more. With these scripts and the ability to make your own we hope to empower the community to come up with creative ways to expand KoboldAI similar to how AI Dungeon's scripts enabled some really cool stuff.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  • transformers

    🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

    If you like the technical details on why this double loading is needed to save up memory you can read it here : https://github.com/huggingface/transformers/pull/13466

  • KoboldAI-Horde-Bridge

    Discontinued Turns KoboldAI into a crowdsourced distributed cluster

    A crowsourced cluster to use with KoboldAI

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts