gpt-2 VS bevy_retro

Medium models: Roughly between 1B to 10B parameters. This is where Mistral 7B, Phi-3, Gemma from Google DeepMind, and wizardlm2 sit. Fun fact: GPT 2 was a medium sized model, much smaller than its latest versions.

"Our model, called GPT-2 (a successor to GPT), was trained simply to predict the next word in 40GB of Internet text. Due to our concerns about malicious applications of the technology, we are not releasing the trained model. As an experiment in responsible disclosure, we are instead releasing a much smaller model for researchers to experiment with, as well as a technical paper. "

They did release GPT-2 under the MIT License.

Did you arrive at this certainty through reading something other than what OpenAI has published? The document [0] that describes the training data for GPT-2 makes this assertion hilarious to me.

[0]: https://github.com/openai/gpt-2/blob/master/model_card.md#da...

I made a clone of https://github.com/openai/gpt-2 on my local laptop

https://github.com/katharostech/bevy_retrograde/blob/master/LICENSE.md section 6.2

There are programming projects[1] out there that use licenses to prevent people from using projects in ways the authors don't agree with. You could also argue that GPL does the same thing (prevents people from using/distributing the software in the way they would like).

Whether you consider it moral doesn't seem relevant, only to respect the wishes of the author of such programs.

[1] https://github.com/katharostech/bevy_retrograde/blob/master/...

A "copyleft" licence such as GPL requires any software that uses it to also be licensed under GPL or equivalent. Then there's more esoteric licences such as Katharos.

speaking of, check the lisence on this bad boy: https://github.com/katharostech/bevy_retro