Yi VS ChatGLM2-6B

The model license:

https://github.com/01-ai/Yi/blob/main/MODEL_LICENSE_AGREEMEN...

1) Your use of the Yi Series Models must comply with the Laws and Regulations as

01.ai's Yi model has performed well and there are several strong fine-tunes on Huggingface also.

I wonder what definition of "open source" the author is using or if he even read the license Yi is released under.

The Yi model license agreement [1] restricts usage and requires compliance with the "laws and administrative regulations of the mainland of the People's Republic of China" and they have a separate license that you can apply for if you want to use Yi commercially. [2]

Kudos to the 01.ai team on a strong LLM model but I do wonder if Wired and others should be a little more careful with the use of "open source" when describing AI models.

1. https://github.com/01-ai/Yi/blob/main/MODEL_LICENSE_AGREEMEN...

I doubt it, training a foundational model (very important to make the difference with language model) make very little economic sense when there's already plenty of open source option. And in fact, almost all AI startup use/fine-tune these models. Only big research center will do foundational research, as it as always been the case. (Mistral and 01.ai are outliers, and I don't see how they're ever gonna recoup their cost)

Yi-34b: https://github.com/01-ai/Yi

The 6B model is unfortunately still a base text completion model. I've been waiting for the Chat version it to be open-sourced :). The 01-ai team is working on it! https://github.com/01-ai/Yi/issues/173

If its benchmark results, eg on MMLU few-shot, hold and are indicative of its actual performance (which, mind you, isn't a given, for 6B nor for 130B), this 6B should be competitive with decent 30Bs. Plus natively long context and MQA. This is genuinely interesting, unlike boomer noises about CCP poisoning our checkpoints or whatever.