Pyg7b models doesn't load at all

This page summarizes the projects mentioned and recommended in the original post on /r/KoboldAI

WorkOS
Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
Our great sponsors

  • KoboldAI

    • I haven't been keeping up-to-date on KoboldAI (I tend to use Ooba) but it was my understanding that KAI couldn't yet load 4bit models, unless you were using 0cc4m's fork. Are you using that one? https://github.com/0cc4m/KoboldAI

  • KoboldAI

    • I've tried main KoboldAI and two forks so far and must admit that this one is the best: https://github.com/henk717/KoboldAI and goes with .exe installer as well. I use it with 7b models without any complications.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts