Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
Why do you think that https://github.com/THUDM/ChatGLM-6B is a good alternative to basaran