ChatGLM, an open-source, self-hosted dialogue language model and alternative to ChatGPT created by Tsinghua University, can be run with as little as 6GB of GPU memory.

• ChatGLM-6B

  17 39,341 8.4 Python

  ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

  

The software itself is licenced under Apache License 2.0, you can always use the software to train your own model if you want to "harm the public interest of society, or infringe upon the rights and interests of human beings".

• basaran

  22 1,281 10.0 Python

  Discontinued Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

  

The ChatGLM image was built using this Dockerfile, basically it's just a "bundled" version of Basaran. The complete usage guide is available here (though not specific to ChatGLM).

• WorkOS

  workos.com featured

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• stable-diffusion-webui

  2,808 129,975 9.9 Python

  Stable Diffusion web UI

For AI artwork there is Stable Diffusion.

• text-generation-webui

  876 36,293 9.9 Python

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

This one has an interface similar to A1111.

• alpaca.cpp

  94 9,878 9.4 C

  Discontinued Locally run an Instruction-Tuned Chat-Style LLM

This one runs entirely on a CPU. It's a fork of this repo and uses the newly release Alpaca LORA for the LLaMa model.

• llama.cpp

  772 56,891 10.0 C++

  LLM inference in C/C++

This one runs entirely on a CPU. It's a fork of this repo and uses the newly release Alpaca LORA for the LLaMa model.

Suggest a related project