Yi VS Chinese-LLaMA-Alpaca

The model license:

https://github.com/01-ai/Yi/blob/main/MODEL_LICENSE_AGREEMEN...

1) Your use of the Yi Series Models must comply with the Laws and Regulations as

01.ai's Yi model has performed well and there are several strong fine-tunes on Huggingface also.

I wonder what definition of "open source" the author is using or if he even read the license Yi is released under.

The Yi model license agreement [1] restricts usage and requires compliance with the "laws and administrative regulations of the mainland of the People's Republic of China" and they have a separate license that you can apply for if you want to use Yi commercially. [2]

Kudos to the 01.ai team on a strong LLM model but I do wonder if Wired and others should be a little more careful with the use of "open source" when describing AI models.

1. https://github.com/01-ai/Yi/blob/main/MODEL_LICENSE_AGREEMEN...

I doubt it, training a foundational model (very important to make the difference with language model) make very little economic sense when there's already plenty of open source option. And in fact, almost all AI startup use/fine-tune these models. Only big research center will do foundational research, as it as always been the case. (Mistral and 01.ai are outliers, and I don't see how they're ever gonna recoup their cost)

Yi-34b: https://github.com/01-ai/Yi

The 6B model is unfortunately still a base text completion model. I've been waiting for the Chat version it to be open-sourced :). The 01-ai team is working on it! https://github.com/01-ai/Yi/issues/173

I'd like to share with you today the Chinese-Alpaca-Plus-13B-GPTQ model, which is the GPTQ format quantised 4bit models of Yiming Cui's Chinese-LLaMA-Alpaca 13B for GPU reference.

Could follow what people did with the Chinese-LLaMA, just for Korean. Might want to have a pure Korean corpus before feeding in a translation dataset. How big is it by the way?

Chinese: https://github.com/ymcui/Chinese-LLaMA-Alpaca