Yi
ChatGLM2-6B
Yi | ChatGLM2-6B | |
---|---|---|
9 | 4 | |
7,141 | 15,495 | |
2.8% | 0.8% | |
9.4 | 7.0 | |
4 days ago | 22 days ago | |
Python | Python | |
Apache License 2.0 | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Yi
-
Yi: Open Foundation Models by 01.ai
The model license:
https://github.com/01-ai/Yi/blob/main/MODEL_LICENSE_AGREEMEN...
1) Your use of the Yi Series Models must comply with the Laws and Regulations as
-
Chinese Startup Is Winning the Open Source AI Race
01.ai's Yi model has performed well and there are several strong fine-tunes on Huggingface also.
I wonder what definition of "open source" the author is using or if he even read the license Yi is released under.
The Yi model license agreement [1] restricts usage and requires compliance with the "laws and administrative regulations of the mainland of the People's Republic of China" and they have a separate license that you can apply for if you want to use Yi commercially. [2]
Kudos to the 01.ai team on a strong LLM model but I do wonder if Wired and others should be a little more careful with the use of "open source" when describing AI models.
1. https://github.com/01-ai/Yi/blob/main/MODEL_LICENSE_AGREEMEN...
-
EU regulation implications ?
I doubt it, training a foundational model (very important to make the difference with language model) make very little economic sense when there's already plenty of open source option. And in fact, almost all AI startup use/fine-tune these models. Only big research center will do foundational research, as it as always been the case. (Mistral and 01.ai are outliers, and I don't see how they're ever gonna recoup their cost)
-
What the heck is so great about this model?
Yi-34b: https://github.com/01-ai/Yi
-
Yi-34B-Chat
The 6B model is unfortunately still a base text completion model. I've been waiting for the Chat version it to be open-sourced :). The 01-ai team is working on it! https://github.com/01-ai/Yi/issues/173
- 零一万物-AI2.0大模型技术和应用的全球公司(01.AI)- Source of Yi 34B LLM AI
- Kai-Fu Lee's Yi-34B uses Llama's architecture except for two tensors renamed
- 01-AI/Yi: A series of large language models trained from scratch
ChatGLM2-6B
- Are We Overlooking China's Progress in AI?
-
A new open-source language model claims to have surpassed GPT-4 right now. This needs to be fact-checked
If its benchmark results, eg on MMLU few-shot, hold and are indicative of its actual performance (which, mind you, isn't a given, for 6B nor for 130B), this 6B should be competitive with decent 30Bs. Plus natively long context and MQA. This is genuinely interesting, unlike boomer noises about CCP poisoning our checkpoints or whatever.
What are some alternatives?
MOSS - An open-source tool-augmented conversational language model from Fudan University
PentestGPT - A GPT-empowered penetration testing tool